Nov 02 12:28:59 devstack cinder-volume[75678]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:28:59 devstack cinder-volume[75678]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:28:59 devstack cinder-volume[75678]: we strongly recommend against using it for new projects. Nov 02 12:28:59 devstack cinder-volume[75678]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:28:59 devstack cinder-volume[75678]: framework. For more detail see Nov 02 12:28:59 devstack cinder-volume[75678]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:28:59 devstack cinder-volume[75678]: import eventlet # noqa Nov 02 12:29:02 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:29:02 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:29:02 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:29:03 devstack cinder-volume[75678]: INFO dbcounter [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Registered counter for database cinder Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG dbcounter [-] [75678] Writer thread running {{(pid=75678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:29:03 devstack cinder-volume[75678]: INFO cinder.rpc [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:29:03 devstack cinder-volume[75678]: INFO cinder.rpc [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:29:03 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Determined volume DB was empty at startup. Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG cinder.volume.manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75678) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:29:03 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 12:29:03 devstack cinder-volume[75678]: WARNING stevedore.named [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:29:03 devstack cinder-volume[75678]: WARNING castellan.key_manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:29:03 devstack cinder-volume[75678]: WARNING cinder.keymgr.conf_key_mgr [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG cinder.volume.drivers.lvm [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75678) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 12:29:03 devstack cinder-volume[75678]: DEBUG oslo_concurrency.processutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_concurrency.processutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=75678) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:29:04 devstack cinder-volume[75678]: INFO cinder.rpc [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 12:29:04 devstack cinder-volume[75678]: INFO cinder.rpc [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 12:29:04 devstack cinder-volume[75678]: WARNING stevedore.named [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:29:04 devstack cinder-volume[75678]: WARNING castellan.key_manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:29:04 devstack cinder-volume[75678]: INFO cinder.volume.manager [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_db.sqlalchemy.engines [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:29:04 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Starting 1 workers Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Started child 75838 {{(pid=75678) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Full set of CONF: {{(pid=75678) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] ******************************************************************************** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Configuration options gathered from: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] ================================================================================ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] allow_availability_zone_fallback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] allow_compression_on_image_upload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] allowed_direct_url_schemes = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] api_rate_limit = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] auth_strategy = keystone {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] az_cache_duration = 3600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_host = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_stats_polling_interval = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backup_api_class = cinder.backup.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backup_name_template = backup-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backup_use_same_host = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backup_use_temp_snapshot = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] chap_username = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_internal_tenant_project_id = e219b4bb0f7c45fe97ce833859513f71 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_internal_tenant_user_id = ad5b25fed54c4a78a31e3d48671cc922 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cloned_volume_same_az = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cluster = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] compression_format = gzip {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] compute_api_class = cinder.compute.nova.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] config_dir = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] config_source = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] control_exchange = openstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] debug = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] default_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] default_group_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] default_volume_type = lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_ssl_cert_verify = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] driver_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] enable_force_upload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] enable_new_services = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] enable_unsupported_driver = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] enforce_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_api_insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_api_servers = ['http://192.168.122.28/image'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_api_ssl_compression = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_ca_certificates_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_catalog_info = image:glance:publicURL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_num_retries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance_request_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] graceful_shutdown_timeout = 5 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] group_api_class = cinder.group.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] host = devstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_compress_on_upload = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_conversion_address_space_limit = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_conversion_cpu_limit = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_conversion_disable = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_introspection_address_space_limit = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_introspection_cpu_limit = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_upload_use_cinder_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_upload_use_internal_tenant = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_volume_cache_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_volume_cache_max_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] image_volume_cache_max_size_gb = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] init_host_max_objects_retrieval = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] instance_format = [instance: %(uuid)s] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iscsi_target_flags = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iscsi_write_cache = on {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iser_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iser_ip_address = 192.168.122.28 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iser_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_color = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_config_append = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_options = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_rotate_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_rotate_interval_type = days {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] log_rotation_type = none {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] luks_passphrase_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] max_age = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] max_logfile_count = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] max_logfile_size_mb = 200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] max_over_subscription_ratio = 20.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] message_reap_interval = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] message_ttl = 2592000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] migration_create_volume_timeout_secs = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] monkey_patch = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] monkey_patch_modules = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] my_ip = 192.168.122.28 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] no_snapshot_gb_quota = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] num_iser_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] num_shell_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] num_volume_device_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] nvmeof_conn_info_version = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] nvmet_ns_id = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] nvmet_port_id = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_max_limit = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_ext_list = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_listen_port = 8776 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] osapi_volume_workers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] per_volume_size_limit = -1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] periodic_fuzzy_delay = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] periodic_interval = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] public_endpoint = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] publish_errors = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_backup_gigabytes = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_backups = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_gigabytes = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_groups = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_snapshots = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] quota_volumes = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] rate_limit_burst = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] rate_limit_except_level = CRITICAL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] rate_limit_interval = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] reinit_driver_count = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] report_discard_supported = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] report_interval = 120 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] reservation_clean_interval = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] reservation_expire = 86400 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] reserved_image_namespaces = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] reserved_percentage = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] rpc_response_timeout = 120 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] run_external_periodic_tasks = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] scst_target_driver = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_down_time = 720 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] shell_completion = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] snapshot_name_template = snapshot-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] snapshot_same_host = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] state_path = /opt/stack/data/cinder {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] storage_availability_zone = nova {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] storage_protocol = iSCSI {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] syslog_log_facility = LOG_USER {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_helper = lioadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_ip_address = 192.168.122.28 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] target_secondary_ip_addresses = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] transport_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] until_refresh = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_chap_auth = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_default_quota_class = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_journal = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_json = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_stderr = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] use_syslog = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] verify_glance_signatures = enabled {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_api_class = cinder.volume.api.API {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_clear_size = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_copy_bps_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_dd_blocksize = 1M {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_name_template = volume-%s {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_service_inithost_offload = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volume_usage_audit_period = month {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] zoning_mode = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_concurrency.disable_process_locking = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.auth_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.cache = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.include_service_catalog = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.interface = public {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcache_username = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.service_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.backend = dogpile.cache.null {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.backend_argument = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.backend_expiration_time = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.config_prefix = cache.oslo {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.debug_cache_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.enable_retry_client = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.enable_socket_keepalive = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.expiration_time = 600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.hashclient_retry_attempts = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_dead_retry = 300 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_pool_maxsize = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_sasl_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.proxies = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack sudo[75842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 12:29:04 devstack sudo[75842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.redis_db = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.redis_server = localhost:6379 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.retry_attempts = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.retry_delay = 0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.socket_keepalive_count = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.socket_keepalive_idle = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.socket_keepalive_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.socket_timeout = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.tls_allowed_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.tls_cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.tls_certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.tls_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.tls_keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cache.username = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] coordination.backend_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.asyncio_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.asyncio_slave_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.backend = sqlalchemy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.connection_debug = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.connection_parameters = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.connection_recycle_time = 3600 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.connection_trace = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.db_inc_retry_interval = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.db_max_retries = 20 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.db_max_retry_interval = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.db_retry_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.max_overflow = 50 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.max_pool_size = 5 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.max_retries = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.mysql_wsrep_sync_wait = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.pool_timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.retry_interval = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.slave_connection = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.sqlite_synchronous = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.synchronous_reader = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] database.use_db_reconnect = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_tracing.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.connection_string = messaging:// {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.es_doc_type = notification {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.es_scroll_size = 10000 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.es_scroll_time = 2m {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.filter_error_trace = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.hmac_keys = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.sentinel_service_name = mymaster {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.socket_timeout = 0.1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.trace_requests = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler.trace_sqlalchemy = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler_jaeger.process_tags = {} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler_jaeger.service_name_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] profiler_otlp.service_name_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.enforce_new_defaults = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.policy_default_rule = default {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.policy_file = policy.yaml {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.group = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.helper_command = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] privsep_osbrick.user = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.group = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.helper_command = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] cinder_sys_admin.user = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.send_service_user_token = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.tls_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] service_user.tls_min_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.auth_type = password {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.tls_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] glance.tls_min_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.chap_username = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.driver_use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.extra_capabilities = {} {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iscsi_target_flags = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iscsi_write_cache = on {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iser_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iser_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.lvm_share_target = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.lvm_type = auto {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.num_shell_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.report_discard_supported = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.reserved_percentage = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_helper = tgtadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.unique_fqdn_network = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.use_chap_auth = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_backend_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_clear_size = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_reports.file_event_handler = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_reports.log_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.backend_host = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.chap_password = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.chap_username = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.disk_geometry = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_client_cert = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.extra_capabilities = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.filter_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.goodness_function = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iser_helper = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iser_ip_address = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iser_port = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.lvm_share_target = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.lvm_type = auto {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.num_shell_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.replication_device = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.report_discard_supported = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.reserved_percentage = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.scst_target_driver = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.storage_protocol = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_helper = lioadm {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_ip_address = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_port = 3260 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.trace_flags = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.use_chap_auth = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_clear = zero {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_clear_size = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] lvmdriver-1.volumes_dir = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:04 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_notifications.driver = [] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_notifications.retry = -1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] key_manager.fixed_key = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.barbican_api_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.barbican_endpoint = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.barbican_endpoint_type = public {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.barbican_region_name = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.number_of_retries = 60 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.retry_delay = 1 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.send_service_user_token = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.tls_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.tls_min_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.verify_ssl = True {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican.verify_ssl_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.auth_section = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.auth_type = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.cafile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.certfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.collect_timing = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.insecure = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.keyfile = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.split_loggers = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.timeout = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.tls_ciphers = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] barbican_service_user.tls_min_version = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.approle_role_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.approle_secret_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.auth_method = approle {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.auth_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.kv_mountpoint = secret {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.kv_path = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.kv_version = 2 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.namespace = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.root_token_id = **** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.ssl_ca_crt_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.timeout = 60.0 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.token_file = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.token_role = None {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.use_ssl = False {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:29:05 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] ******************************************************************************** {{(pid=75678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:29:05 devstack sudo[75842]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:05 devstack sudo[75846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:05 devstack sudo[75846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:05 devstack sudo[75846]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.291s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:05 devstack cinder-volume[75838]: INFO cinder.brick.local_dev.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:05 devstack sudo[75853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:05 devstack sudo[75853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:05 devstack sudo[75853]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG cinder.brick.local_dev.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75838) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 12:29:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:05 devstack sudo[75983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:05 devstack sudo[75983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:06 devstack sudo[75983]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:06 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:06 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack sudo[76295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 12:29:06 devstack sudo[76295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:06 devstack sudo[76295]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:06 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[76460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:07 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:07 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[76547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:07 devstack sudo[76547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack sudo[76547]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[76557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:08 devstack sudo[76557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack sudo[76557]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: INFO cinder.volume.drivers.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:08 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:08 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:08 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:09 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:09 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:09 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[76659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:09 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:09 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:09 devstack cinder-volume[75838]: INFO cinder.volume.driver [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG cinder.volume.driver [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75838) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_db.sqlalchemy.engines [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75838) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writer thread running {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG cinder.db.api [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Building query based on filter {{(pid=75838) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG cinder.image.image_utils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75838) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Nov 02 12:29:09 devstack cinder-volume[75838]: INFO cinder.keymgr.migration [None req-a09b15f0-d340-436c-87b2-953dfb66e675 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:29:09 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:09 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:10 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:10 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:10 devstack sudo[76670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:10 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:10 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:10 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[75838]: DEBUG cinder.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Notifying Schedulers of capabilities ... {{(pid=75838) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:11 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Driver initialization completed successfully. Nov 02 12:29:11 devstack cinder-volume[75838]: INFO cinder.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Initiating service 2 cleanup Nov 02 12:29:11 devstack cinder-volume[75838]: INFO cinder.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Service 2 cleanup completed. Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG cinder.service [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Creating RPC server for service cinder-volume {{(pid=75838) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG cinder.service [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75838) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:29:11 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack sudo[76678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:29:11 devstack sudo[76678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:11 devstack sudo[76678]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack sudo[76681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:11 devstack sudo[76681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:11 devstack sudo[76681]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack sudo[76684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:29:11 devstack sudo[76684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:11 devstack sudo[76684]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:11 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:29:11 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:12 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[75838]: INFO cinder.volume.manager [None req-d2f7a483-2300-4d71-b2ec-d70e80856d91 None None] Driver post RPC initialization completed successfully. Nov 02 12:29:14 devstack cinder-volume[75678]: DEBUG dbcounter [-] [75678] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:29:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:29:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:05 devstack sudo[78586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:30:05 devstack sudo[78586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:05 devstack sudo[78586]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:05 devstack sudo[78589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:30:05 devstack sudo[78589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:05 devstack sudo[78589]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:05 devstack sudo[78610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:30:05 devstack sudo[78610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:06 devstack sudo[78610]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:06 devstack sudo[78613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:30:06 devstack sudo[78613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:06 devstack sudo[78613]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG cinder.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Notifying Schedulers of capabilities ... {{(pid=75838) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager._thread_info {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread count: 6 {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:30:06 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread info: [<_MainThread(MainThread, started 123432811118720)>, , , , , ] {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:05 devstack sudo[81904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:31:05 devstack sudo[81904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:05 devstack sudo[81904]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:05 devstack sudo[81908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:31:05 devstack sudo[81908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:05 devstack sudo[81908]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:05 devstack sudo[81911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:31:05 devstack sudo[81911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:06 devstack sudo[81911]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:06 devstack sudo[81921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:31:06 devstack sudo[81921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:06 devstack sudo[81921]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:06 devstack cinder-volume[75838]: DEBUG cinder.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Notifying Schedulers of capabilities ... {{(pid=75838) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:SELECT=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:31:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:UPDATE=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG cinder.volume.drivers.lvm [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Updating volume stats {{(pid=75838) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:05 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:32:05 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:05 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:05 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:32:05 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:05 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:05 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:05 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:32:05 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:06 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:06 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:32:06 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:06 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG oslo_concurrency.processutils [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75838) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG cinder.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Notifying Schedulers of capabilities ... {{(pid=75838) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager._thread_info {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread count: 6 {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:32:06 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread info: [<_MainThread(MainThread, started 123432811118720)>, , , , , ] {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:33:05 devstack cinder-volume[75838]: DEBUG oslo_service.periodic_task [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] Running periodic task VolumeManager._thread_info {{(pid=75838) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:33:05 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread count: 6 {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:33:05 devstack cinder-volume[75838]: DEBUG cinder.volume.manager [None req-b8b0cda9-1a87-4bd2-85ec-34657789dc13 None None] thread info: [<_MainThread(MainThread, started 123432811118720)>, , , , , ] {{(pid=75838) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:33:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:SELECT=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:33:22 devstack cinder-volume[75838]: DEBUG dbcounter [-] [75838] Writing DB stats cinder:UPDATE=1 {{(pid=75838) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:33:29 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Caught SIGTERM, stopping children Nov 02 12:33:29 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Acquiring lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:29 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Acquired lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:29 devstack cinder-volume[75678]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Releasing lock "singleton_lock" {{(pid=75678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:29 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Stop services. {{(pid=75678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 12:33:29 devstack cinder-volume[75678]: DEBUG oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Killing children. {{(pid=75678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 12:33:29 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Waiting on 1 children to exit Nov 02 12:33:31 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Acquiring lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:31 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Acquired lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:31 devstack cinder-volume[75838]: DEBUG oslo_concurrency.lockutils [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Releasing lock "singleton_lock" {{(pid=75838) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:31 devstack cinder-volume[75838]: WARNING amqp [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:33:31 devstack cinder-volume[75838]: WARNING amqp [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:33:31 devstack cinder-volume[75678]: INFO oslo_service.backend._eventlet.service [None req-3c73dd4a-c1c8-445b-a13b-8ada7d3ed059 None None] Child 75838 exited with status 0 Nov 02 12:33:31 devstack cinder-volume[85863]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:33:31 devstack cinder-volume[85863]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:33:31 devstack cinder-volume[85863]: we strongly recommend against using it for new projects. Nov 02 12:33:31 devstack cinder-volume[85863]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:33:31 devstack cinder-volume[85863]: framework. For more detail see Nov 02 12:33:31 devstack cinder-volume[85863]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:33:31 devstack cinder-volume[85863]: import eventlet # noqa Nov 02 12:33:33 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:33 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:33 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:34 devstack cinder-volume[85863]: INFO dbcounter [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Registered counter for database cinder Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG dbcounter [-] [85863] Writer thread running {{(pid=85863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:33:34 devstack cinder-volume[85863]: INFO cinder.rpc [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:33:34 devstack cinder-volume[85863]: INFO cinder.rpc [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:34 devstack cinder-volume[85863]: INFO cinder.volume.manager [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Determined volume DB was empty at startup. Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG cinder.volume.manager [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85863) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:33:34 devstack cinder-volume[85863]: INFO cinder.volume.manager [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 12:33:34 devstack cinder-volume[85863]: WARNING stevedore.named [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:33:34 devstack cinder-volume[85863]: WARNING castellan.key_manager [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:33:34 devstack cinder-volume[85863]: WARNING cinder.keymgr.conf_key_mgr [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:33:34 devstack cinder-volume[85863]: INFO cinder.volume.manager [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:34 devstack cinder-volume[85863]: INFO oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Starting 1 workers Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Started child 86081 {{(pid=85863) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Full set of CONF: {{(pid=85863) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] ******************************************************************************** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Configuration options gathered from: {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] ================================================================================ {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] allow_availability_zone_fallback = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] allow_compression_on_image_upload = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] allowed_direct_url_schemes = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] api_rate_limit = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] auth_strategy = keystone {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_availability_zone = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_host = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_stats_polling_interval = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[86081]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backup_api_class = cinder.backup.api.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backup_name_template = backup-%s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backup_use_same_host = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backup_use_temp_snapshot = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] chap_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] chap_username = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_internal_tenant_project_id = e219b4bb0f7c45fe97ce833859513f71 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_internal_tenant_user_id = ad5b25fed54c4a78a31e3d48671cc922 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cluster = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] compression_format = gzip {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] config_dir = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] config_source = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] control_exchange = openstack {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] debug = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] default_availability_zone = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] default_group_type = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] default_volume_type = QuobyteHD {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] disk_geometry = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_client_cert = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_client_cert_key = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_data_namespace = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_ssl_cert_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_ssl_cert_verify = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] driver_use_ssl = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] enable_new_services = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] enable_unsupported_driver = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] enforce_multipath_for_image_xfer = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] filter_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_api_insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_api_servers = ['http://192.168.122.28/image'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_api_ssl_compression = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_ca_certificates_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_num_retries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance_request_timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] goodness_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] graceful_shutdown_timeout = 5 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] group_api_class = cinder.group.api.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] host = devstack {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_compress_on_upload = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_conversion_address_space_limit = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_conversion_cpu_limit = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_conversion_disable = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_introspection_address_space_limit = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_introspection_cpu_limit = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_upload_use_cinder_backend = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_upload_use_internal_tenant = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_volume_cache_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_volume_cache_max_count = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] init_host_max_objects_retrieval = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] instance_format = [instance: %(uuid)s] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iscsi_target_flags = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iscsi_write_cache = on {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iser_helper = tgtadm {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iser_ip_address = 192.168.122.28 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iser_port = 3260 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_color = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_config_append = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_dir = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_options = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_rotate_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_rotate_interval_type = days {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] log_rotation_type = none {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] luks_passphrase_dir = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] max_age = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] max_logfile_count = 30 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] max_logfile_size_mb = 200 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] max_over_subscription_ratio = 20.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] message_reap_interval = 86400 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] message_ttl = 2592000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] monkey_patch = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] monkey_patch_modules = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] my_ip = 192.168.122.28 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] no_snapshot_gb_quota = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] num_iser_scan_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:34 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] num_shell_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] num_volume_device_scan_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] nvmeof_conn_info_version = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] nvmet_ns_id = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] nvmet_port_id = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_max_limit = 1000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_ext_list = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_listen_port = 8776 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_use_ssl = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] osapi_volume_workers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] per_volume_size_limit = -1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] periodic_fuzzy_delay = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] periodic_interval = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.remotefs [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86081) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:224}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] public_endpoint = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] publish_errors = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_backup_gigabytes = 1000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_backups = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_gigabytes = 1000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_groups = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_snapshots = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] quota_volumes = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] rate_limit_burst = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] rate_limit_except_level = CRITICAL {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] rate_limit_interval = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] reinit_driver_count = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] replication_device = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] report_discard_supported = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] report_interval = 120 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] reservation_clean_interval = 86400 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] reservation_expire = 86400 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] reserved_image_namespaces = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] reserved_percentage = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] rpc_response_timeout = 120 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] run_external_periodic_tasks = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] scst_target_driver = iscsi {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] scst_target_iqn_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_down_time = 720 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] shell_completion = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] snapshot_name_template = snapshot-%s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] split_loggers = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] state_path = /opt/stack/data/cinder {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] storage_availability_zone = nova {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] storage_protocol = iSCSI {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] syslog_log_facility = LOG_USER {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_helper = lioadm {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_ip_address = 192.168.122.28 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_port = 3260 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_protocol = iscsi {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] target_secondary_ip_addresses = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] trace_flags = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] transport_url = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] until_refresh = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_chap_auth = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_default_quota_class = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_journal = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_json = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_multipath_for_image_xfer = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_stderr = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] use_syslog = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] verify_glance_signatures = enabled {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_api_class = cinder.volume.api.API {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_backend_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_clear = zero {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_clear_ionice = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_clear_size = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_copy_bps_limit = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_dd_blocksize = 1M {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_name_template = volume-%s {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_service_inithost_offload = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volume_usage_audit_period = month {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] zoning_mode = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.auth_section = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.auth_type = password {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.auth_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.cache = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.interface = public {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcache_username = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.region_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.service_type = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.backend = dogpile.cache.null {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.backend_argument = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.backend_expiration_time = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.config_prefix = cache.oslo {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.debug_cache_backend = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.enable_retry_client = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.enable_socket_keepalive = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.expiration_time = 600 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_dead_retry = 300 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_sasl_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.proxies = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86081) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 12:33:35 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 12:33:35 devstack cinder-volume[86081]: WARNING cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.redis_db = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.redis_server = localhost:6379 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.retry_attempts = 2 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.retry_delay = 0.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.socket_keepalive_count = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.socket_keepalive_idle = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Running cmd (subprocess): mount.quobyte {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.socket_keepalive_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.socket_timeout = 1.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.tls_allowed_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.tls_cafile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.tls_certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.tls_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.tls_keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cache.username = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] coordination.backend_url = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.asyncio_connection = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.asyncio_slave_connection = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.backend = sqlalchemy {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.connection = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.connection_debug = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.connection_parameters = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.connection_recycle_time = 3600 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.connection_trace = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.db_inc_retry_interval = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.db_max_retries = 20 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.db_max_retry_interval = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.db_retry_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.max_overflow = 50 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.max_pool_size = 5 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.max_retries = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.pool_timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.retry_interval = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.slave_connection = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.sqlite_synchronous = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.synchronous_reader = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] database.use_db_reconnect = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_tracing.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.connection_string = messaging:// {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.es_doc_type = notification {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.es_scroll_size = 10000 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.es_scroll_time = 2m {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.filter_error_trace = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.hmac_keys = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.sentinel_service_name = mymaster {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.socket_timeout = 0.1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.trace_requests = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler.trace_sqlalchemy = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler_jaeger.process_tags = {} {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] profiler_otlp.service_name_prefix = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.policy_default_rule = default {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.group = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.helper_command = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] privsep_osbrick.user = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.group = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.helper_command = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] cinder_sys_admin.user = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.auth_section = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.auth_type = password {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.cafile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.collect_timing = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.send_service_user_token = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.split_loggers = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.tls_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] service_user.tls_min_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.auth_section = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.auth_type = password {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.collect_timing = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.region_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.split_loggers = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.tls_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] glance.tls_min_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.backend_availability_zone = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.chap_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.chap_username = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.disk_geometry = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_client_cert = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_data_namespace = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.driver_use_ssl = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.extra_capabilities = {} {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.filter_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.goodness_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iscsi_target_flags = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iser_port = 3260 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_host = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_login = admin {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_mount_options = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_private_key = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_share_path = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.replication_device = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.report_discard_supported = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_helper = tgtadm {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_port = 3260 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_protocol = iscsi {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.trace_flags = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.use_chap_auth = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_backend_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_clear = zero {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_reports.file_event_handler = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_reports.log_dir = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.backend_host = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.chap_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.chap_username = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.disk_geometry = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_client_cert = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack quobyte-client[86082]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 12:33:35 devstack quobyte-client[86082]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.extra_capabilities = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.filter_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.goodness_function = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iser_helper = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iser_ip_address = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iser_port = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 ... Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 -c /etc/quobyte/client-cinder.cfg {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_host = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_login = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_mount_options = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_password = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_private_key = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_share_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.num_shell_tries = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.replication_device = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.report_discard_supported = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.reserved_percentage = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.scst_target_driver = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.storage_protocol = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_helper = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_ip_address = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_port = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_prefix = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_protocol = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.trace_flags = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.use_chap_auth = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_clear = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_clear_size = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] QuobyteHD.volumes_dir = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 -c /etc/quobyte/client-cinder.cfg Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_notifications.driver = [] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] key_manager.fixed_key = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.barbican_api_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.barbican_endpoint = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.barbican_endpoint_type = public {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.barbican_region_name = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.cafile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.collect_timing = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.number_of_retries = 60 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.retry_delay = 1 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.send_service_user_token = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.split_loggers = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.tls_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.tls_min_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.verify_ssl = True {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican.verify_ssl_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.auth_section = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.auth_type = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.cafile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.certfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.collect_timing = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.insecure = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.keyfile = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.split_loggers = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.timeout = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.tls_ciphers = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] barbican_service_user.tls_min_version = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.approle_role_id = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.approle_secret_id = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.auth_method = approle {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.auth_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.kv_mountpoint = secret {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.kv_path = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.kv_version = 2 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.namespace = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.root_token_id = **** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.ssl_ca_crt_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.timeout = 60.0 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.token_file = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.token_role = None {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.use_ssl = False {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:35 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] ******************************************************************************** {{(pid=85863) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:33:35 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.427s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:35 devstack cinder-volume[86081]: INFO cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 succeeded Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.440s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:35 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:35 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:35 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.225s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:35 devstack cinder-volume[86081]: INFO cinder.volume.driver [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG cinder.volume.driver [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7848472595215, 'free_capacity_gb': 1773.7848472595215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 12:33:35 devstack cinder-volume[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG dbcounter [-] [86081] Writer thread running {{(pid=86081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.db.api [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Building query based on filter {{(pid=86081) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.image.image_utils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.keymgr.migration [None req-0d9faadd-c972-4049-9e26-335cf0a306f3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:36 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:36 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:36 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.227s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Driver initialization completed successfully. Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Initiating service 3 cleanup Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Service 3 cleanup completed. Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.service [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Creating RPC server for service cinder-volume {{(pid=86081) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.service [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86081) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:36 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:36 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:36 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:36 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.259s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:36 devstack cinder-volume[86081]: INFO cinder.volume.manager [None req-b850454c-2479-4ec6-acdb-b91f6e213bb5 None None] Driver post RPC initialization completed successfully. Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86081) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG cinder.volume.drivers.quobyte [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86081) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86081) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:41 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:41 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:41 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG oslo_concurrency.processutils [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.237s {{(pid=86081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:41 devstack cinder-volume[86081]: DEBUG cinder.manager [None req-0ccd7da3-a457-495c-90c0-2b820e35d496 None None] Notifying Schedulers of capabilities ... {{(pid=86081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:42 devstack cinder-volume[85863]: INFO oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Caught SIGTERM, stopping children Nov 02 12:33:42 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Acquiring lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:42 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Acquired lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:42 devstack cinder-volume[85863]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Releasing lock "singleton_lock" {{(pid=85863) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:42 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Stop services. {{(pid=85863) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 12:33:42 devstack cinder-volume[85863]: DEBUG oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Killing children. {{(pid=85863) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 12:33:42 devstack cinder-volume[85863]: INFO oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Waiting on 1 children to exit Nov 02 12:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Acquiring lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Acquired lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:44 devstack cinder-volume[86081]: DEBUG oslo_concurrency.lockutils [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Releasing lock "singleton_lock" {{(pid=86081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:44 devstack cinder-volume[86081]: WARNING amqp [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:33:44 devstack cinder-volume[86081]: WARNING amqp [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:33:44 devstack cinder-volume[85863]: INFO oslo_service.backend._eventlet.service [None req-a5c8913e-63af-41d3-8c7b-7c75f014d4a2 None None] Child 86081 exited with status 0 Nov 02 12:33:45 devstack cinder-volume[86431]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:33:45 devstack cinder-volume[86431]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:33:45 devstack cinder-volume[86431]: we strongly recommend against using it for new projects. Nov 02 12:33:45 devstack cinder-volume[86431]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:33:45 devstack cinder-volume[86431]: framework. For more detail see Nov 02 12:33:45 devstack cinder-volume[86431]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:33:45 devstack cinder-volume[86431]: import eventlet # noqa Nov 02 12:33:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:33:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:33:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:33:48 devstack cinder-volume[86431]: INFO dbcounter [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Registered counter for database cinder Nov 02 12:33:48 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writer thread running {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:33:49 devstack cinder-volume[86431]: INFO cinder.rpc [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:33:49 devstack cinder-volume[86431]: INFO cinder.rpc [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Determined volume DB was empty at startup. Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86431) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:33:49 devstack cinder-volume[86431]: WARNING stevedore.named [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:33:49 devstack cinder-volume[86431]: WARNING castellan.key_manager [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:33:49 devstack cinder-volume[86431]: WARNING cinder.keymgr.conf_key_mgr [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:33:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:49 devstack cinder-volume[86431]: INFO oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Starting 1 workers Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Started child 86731 {{(pid=86431) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Full set of CONF: {{(pid=86431) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] ******************************************************************************** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] Configuration options gathered from: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] ================================================================================ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] allow_availability_zone_fallback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] allow_compression_on_image_upload = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] allowed_direct_url_schemes = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] api_rate_limit = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] auth_strategy = keystone {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86731]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_stats_polling_interval = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backup_api_class = cinder.backup.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backup_name_template = backup-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backup_use_same_host = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backup_use_temp_snapshot = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] chap_username = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_internal_tenant_project_id = e219b4bb0f7c45fe97ce833859513f71 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_internal_tenant_user_id = ad5b25fed54c4a78a31e3d48671cc922 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cluster = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] compression_format = gzip {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] config_dir = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] config_source = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] control_exchange = openstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] debug = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] default_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] default_group_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] default_volume_type = QuobyteHD {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_ssl_cert_verify = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] driver_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] enable_new_services = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] enable_unsupported_driver = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] enforce_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_api_insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_api_servers = ['http://192.168.122.28/image'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_api_ssl_compression = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_ca_certificates_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_num_retries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance_request_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] graceful_shutdown_timeout = 5 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] group_api_class = cinder.group.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] host = devstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_compress_on_upload = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_conversion_address_space_limit = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_conversion_cpu_limit = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_conversion_disable = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_introspection_address_space_limit = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_introspection_cpu_limit = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_upload_use_cinder_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_upload_use_internal_tenant = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_volume_cache_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_volume_cache_max_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] init_host_max_objects_retrieval = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] instance_format = [instance: %(uuid)s] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iscsi_target_flags = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iscsi_write_cache = on {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iser_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iser_ip_address = 192.168.122.28 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iser_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_color = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_config_append = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_options = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_rotate_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_rotate_interval_type = days {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] log_rotation_type = none {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] luks_passphrase_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] max_age = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] max_logfile_count = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] max_logfile_size_mb = 200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] max_over_subscription_ratio = 20.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] message_reap_interval = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] message_ttl = 2592000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] monkey_patch = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] monkey_patch_modules = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] my_ip = 192.168.122.28 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] no_snapshot_gb_quota = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] num_iser_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] num_shell_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] num_volume_device_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] nvmeof_conn_info_version = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] nvmet_ns_id = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] nvmet_port_id = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_max_limit = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_ext_list = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_listen_port = 8776 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] osapi_volume_workers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] per_volume_size_limit = -1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] periodic_fuzzy_delay = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] periodic_interval = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] public_endpoint = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] publish_errors = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_backup_gigabytes = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_backups = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_gigabytes = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_groups = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_snapshots = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] quota_volumes = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] rate_limit_burst = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] rate_limit_except_level = CRITICAL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] rate_limit_interval = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] reinit_driver_count = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] report_discard_supported = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] report_interval = 120 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] reservation_clean_interval = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] reservation_expire = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] reserved_image_namespaces = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] reserved_percentage = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] rpc_response_timeout = 120 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] run_external_periodic_tasks = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] scst_target_driver = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_down_time = 720 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] shell_completion = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] snapshot_name_template = snapshot-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] state_path = /opt/stack/data/cinder {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] storage_availability_zone = nova {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] storage_protocol = iSCSI {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] syslog_log_facility = LOG_USER {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_helper = lioadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_ip_address = 192.168.122.28 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86731) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:224}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_protocol = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] target_secondary_ip_addresses = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] transport_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] until_refresh = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_chap_auth = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_default_quota_class = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_journal = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_json = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_stderr = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] use_syslog = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] verify_glance_signatures = enabled {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_api_class = cinder.volume.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_clear = zero {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_clear_size = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_copy_bps_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_dd_blocksize = 1M {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_name_template = volume-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_service_inithost_offload = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volume_usage_audit_period = month {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] zoning_mode = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.auth_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.interface = public {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcache_username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.service_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.28/identity {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.backend = dogpile.cache.null {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.backend_argument = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.backend_expiration_time = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.config_prefix = cache.oslo {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.debug_cache_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.enable_retry_client = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.enable_socket_keepalive = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.expiration_time = 600 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_dead_retry = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_sasl_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.proxies = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.redis_db = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.redis_server = localhost:6379 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.retry_attempts = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.retry_delay = 0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.socket_keepalive_count = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.socket_keepalive_idle = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.socket_keepalive_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.socket_timeout = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.tls_allowed_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.tls_cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.tls_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.tls_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.tls_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cache.username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] coordination.backend_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.asyncio_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.asyncio_slave_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.backend = sqlalchemy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.connection_debug = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.connection_parameters = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.connection_recycle_time = 3600 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.connection_trace = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.db_inc_retry_interval = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.db_max_retries = 20 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.db_max_retry_interval = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.db_retry_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.max_overflow = 50 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.max_pool_size = 5 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.max_retries = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.pool_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.retry_interval = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.slave_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.sqlite_synchronous = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.synchronous_reader = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] database.use_db_reconnect = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_tracing.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.connection_string = messaging:// {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.es_doc_type = notification {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.es_scroll_size = 10000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.es_scroll_time = 2m {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.filter_error_trace = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.hmac_keys = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.sentinel_service_name = mymaster {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.socket_timeout = 0.1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.trace_requests = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler.trace_sqlalchemy = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler_jaeger.process_tags = {} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] profiler_otlp.service_name_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.policy_default_rule = default {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.group = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.helper_command = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] privsep_osbrick.user = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.group = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.helper_command = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] cinder_sys_admin.user = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.send_service_user_token = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] service_user.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86731) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 12:33:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 12:33:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Running cmd (subprocess): mount.quobyte {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] glance.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.chap_username = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.driver_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.extra_capabilities = {} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iscsi_target_flags = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iser_ip_address = 192.168.122.28 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iser_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_host = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_login = admin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_mount_options = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_private_key = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_share_path = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.report_discard_supported = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_ip_address = 192.168.122.28 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_protocol = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.use_chap_auth = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_clear = zero {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_reports.file_event_handler = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_reports.log_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.backend_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.chap_username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.extra_capabilities = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iser_helper = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iser_ip_address = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iser_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_login = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_mount_options = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_private_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_share_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.num_shell_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.report_discard_supported = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.reserved_percentage = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.scst_target_driver = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.storage_protocol = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_helper = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_ip_address = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_protocol = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.use_chap_auth = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_clear = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_clear_size = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] QuobyteHD.volumes_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_notifications.driver = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] key_manager.fixed_key = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.barbican_api_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.barbican_endpoint = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.barbican_endpoint_type = public {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.barbican_region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.number_of_retries = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.retry_delay = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.send_service_user_token = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.verify_ssl = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican.verify_ssl_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.auth_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] barbican_service_user.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.approle_role_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.approle_secret_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.auth_method = approle {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.auth_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.kv_mountpoint = secret {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.kv_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.kv_version = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.root_token_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.ssl_ca_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.token_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.token_role = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:33:49 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-427d15ba-e73b-4d09-8672-b3d6d510c8b2 None None] ******************************************************************************** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:33:49 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:49 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:50 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.volume.driver [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.volume.driver [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8107223510742, 'free_capacity_gb': 1773.8107223510742, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_db.sqlalchemy.engines [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writer thread running {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.db.api [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Building query based on filter {{(pid=86731) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86731) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.keymgr.migration [None req-86400ff6-f026-423b-bd8b-871520985071 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:33:50 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:50 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:50 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Driver initialization completed successfully. Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Initiating service 3 cleanup Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Service 3 cleanup completed. Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.service [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Creating RPC server for service cinder-volume {{(pid=86731) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.service [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86731) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:50 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:33:50 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:50 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3125beaf-b3ad-4e9f-9622-23b17463b534 None None] Driver post RPC initialization completed successfully. Nov 02 12:33:59 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fa32cfcc-3e87-45dd-9267-29417c6bc5f5 tempest-BackendsCapabilitiesAdminTestsJSON-906761838 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8107223510742, 'free_capacity_gb': 1773.8107223510742, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:34:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8af8f3be-7086-406e-b429-dbc5153723cc tempest-BackendsCapabilitiesAdminTestsJSON-906761838 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8107223510742, 'free_capacity_gb': 1773.8107223510742, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:34:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 6 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:34:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:34:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4c4cc95e-e142-4501-a8ab-5b8a257922f1 tempest-GroupSnapshotsV319Test-2078663151 None] Group tempest-GroupSnapshotsV319Test-Group-209006682: creating Nov 02 12:34:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4c4cc95e-e142-4501-a8ab-5b8a257922f1 tempest-GroupSnapshotsV319Test-2078663151 None] Group tempest-GroupSnapshotsV319Test-Group-209006682: created successfully Nov 02 12:34:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4c4cc95e-e142-4501-a8ab-5b8a257922f1 tempest-GroupSnapshotsV319Test-2078663151 None] Create group completed successfully. Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Flow 'volume_create_manager' (dbe1918d-18b4-404a-a543-fccb88588bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f5cb9e-36c7-414a-90b6-3e8b68ea1959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f5cb9e-36c7-414a-90b6-3e8b68ea1959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-51370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abffb723-d1ee-4b15-bdb3-7010e88ea29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd290d6949194c13b8823572019ca0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:49Z,use_quota=True,user_id='62620c673fba491d8b9d66551333bc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d03886-0ee8-4b6d-9a8b-14e45774441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d03886-0ee8-4b6d-9a8b-14e45774441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c0ee64-ffdd-4360-8053-b7a5c82cde85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c0ee64-ffdd-4360-8053-b7a5c82cde85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abffb723-d1ee-4b15-bdb3-7010e88ea29f', 'volume_name': 'volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adbb7a2-3248-40fc-b96d-b6f5d0445711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adbb7a2-3248-40fc-b96d-b6f5d0445711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65b665-fb14-42f7-8897-1639511d3834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Volume abffb723-d1ee-4b15-bdb3-7010e88ea29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f', 'volume_size': 1} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-51370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abffb723-d1ee-4b15-bdb3-7010e88ea29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd290d6949194c13b8823572019ca0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:49Z,use_quota=True,user_id='62620c673fba491d8b9d66551333bc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Creating volume abffb723-d1ee-4b15-bdb3-7010e88ea29f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:34:49 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:34:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:49 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f 1073741824 Nov 02 12:34:49 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Flow 'volume_create_manager' (c44ee84e-aedc-4517-929c-d0e75fcbce98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec69291-7041-4a5a-ab78-168479492874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec69291-7041-4a5a-ab78-168479492874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814558489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa393399-9c94-4572-8541-5a8ef0cd3114,host='devstack@QuobyteHD#QuobyteHD',id=2e2bba3b-7665-42d8-a266-0324721fd3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a286b33ed1452e9cee3b6bef2af963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:50Z,use_quota=True,user_id='bdfb95fcce914117b3a7a0cb26e4a380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(369adc4a-2484-4857-9b11-45076f2e89a5),volume_type_id=369adc4a-2484-4857-9b11-45076f2e89a5)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f97edfe-3a59-437a-aba3-341381b3a65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f97edfe-3a59-437a-aba3-341381b3a65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccb7d27-52b0-47a1-987a-76b33d01a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccb7d27-52b0-47a1-987a-76b33d01a477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2bba3b-7665-42d8-a266-0324721fd3f8', 'volume_name': 'volume-2e2bba3b-7665-42d8-a266-0324721fd3f8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87192b85-4556-41db-8fd5-d80f9ac18b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87192b85-4556-41db-8fd5-d80f9ac18b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b64a7-9d00-4285-8017-b9d0ce41ed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:50 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Volume 2e2bba3b-7665-42d8-a266-0324721fd3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2bba3b-7665-42d8-a266-0324721fd3f8', 'volume_size': 1} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f 1073741824" returned: 0 in 0.996s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:50 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f Nov 02 12:34:50 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:50 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:34:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa393399-9c94-4572-8541-5a8ef0cd3114,created_at=2026-11-02T11:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814558489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa393399-9c94-4572-8541-5a8ef0cd3114,host='devstack@QuobyteHD#QuobyteHD',id=2e2bba3b-7665-42d8-a266-0324721fd3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a286b33ed1452e9cee3b6bef2af963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:50Z,use_quota=True,user_id='bdfb95fcce914117b3a7a0cb26e4a380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(369adc4a-2484-4857-9b11-45076f2e89a5),volume_type_id=369adc4a-2484-4857-9b11-45076f2e89a5)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Creating volume 2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:34:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65b665-fb14-42f7-8897-1639511d3834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:51 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 1073741824 Nov 02 12:34:51 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c331721-5959-46aa-a401-2110427c88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Volume volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f (abffb723-d1ee-4b15-bdb3-7010e88ea29f): created successfully Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c331721-5959-46aa-a401-2110427c88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Flow 'volume_create_manager' (dbe1918d-18b4-404a-a543-fccb88588bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7aabddc1-7aaf-4f1a-a54b-676194e576ec tempest-TaggedAttachmentsTest-2099024037 None] Created volume successfully. Nov 02 12:34:51 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 1073741824" returned: 0 in 0.553s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:51 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 Nov 02 12:34:51 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:52 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8" returned: 0 in 0.482s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7b64a7-9d00-4285-8017-b9d0ce41ed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2bba3b-7665-42d8-a266-0324721fd3f8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ddd458-aba5-4122-9e9c-1ca78c7471f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Volume volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 (2e2bba3b-7665-42d8-a266-0324721fd3f8): created successfully Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ddd458-aba5-4122-9e9c-1ca78c7471f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Flow 'volume_create_manager' (c44ee84e-aedc-4517-929c-d0e75fcbce98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-237bb04b-7803-48fb-b3c4-6b03e980c4ad tempest-GroupSnapshotsV319Test-2078663151 None] Created volume successfully. Nov 02 12:34:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] GroupSnapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: creating. Nov 02 12:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Group snapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Creating offline snapshot 82eeb1e3-82bf-41f9-8ad6-08eb592002e1 of volume 2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:34:53 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph_75kv6s/privsep.sock'] Nov 02 12:34:53 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph_75kv6s/privsep.sock Nov 02 12:34:53 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 12:34:54 devstack cinder-volume[86731]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 12:34:54 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:54 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Spawned new privsep daemon via rootwrap Nov 02 12:34:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Accepted privsep connection to /tmp/tmph_75kv6s/privsep.sock {{(pid=86731) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 12:34:54 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 12:34:54 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 12:34:54 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 12:34:54 devstack cinder-volume[86731]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87461 Nov 02 12:34:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ed92d-a272-4e5b-a844-81ef0e06af79]: (2,) {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[44559c39-7ab3-49fd-bd5e-1f4174cdf1bc]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:55 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 Nov 02 12:34:55 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:55 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:55 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 1G Nov 02 12:34:55 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:55 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 1G" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:55 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 Nov 02 12:34:55 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:56 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:56 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:56 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 Nov 02 12:34:56 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:56 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:56 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info Nov 02 12:34:56 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:57 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:57 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:57 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info Nov 02 12:34:57 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:57 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.info" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.836s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a35c623-0b55-40ce-aca6-07f26b129eb9 tempest-GroupSnapshotsV319Test-2078663151 None] group_snapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: created successfully Nov 02 12:34:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] group_snapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: deleting Nov 02 12:34:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] group_snapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "cinder-quobyte-82eeb1e3-82bf-41f9-8ad6-08eb592002e1" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-82eeb1e3-82bf-41f9-8ad6-08eb592002e1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Deleting offline snapshot 82eeb1e3-82bf-41f9-8ad6-08eb592002e1 of volume 2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] snapshot_file for this snap is: volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ad651-210a-4a17-b6a8-e5a192112a23]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:59 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 Nov 02 12:34:59 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:59 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e2bba3b-7665-42d8-a266-0324721fd3f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3838e633-ecdb-490a-a79a-d6abaad6db49]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:59 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 Nov 02 12:34:59 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:00 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8" returned: 0 in 0.559s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:00 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 Nov 02 12:35:00 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:00 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1" returned: 0 in 0.732s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:00 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1 Nov 02 12:35:00 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:01 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8.82eeb1e3-82bf-41f9-8ad6-08eb592002e1" returned: 0 in 0.531s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-82eeb1e3-82bf-41f9-8ad6-08eb592002e1" released by "_delete_snapshot" :: held 2.454s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" released by "delete_snapshot" :: held 2.493s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:01 devstack cinder-volume[86731]: WARNING cinder.quota [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1952216054 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1952216054, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:35:01 devstack cinder-volume[86731]: WARNING cinder.quota [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1952216054 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1952216054, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:35:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] Created reservations ['c15ba5ee-4f60-467d-9486-c11a0307571e', 'f87c6592-b551-43ad-839e-6868f5d42c7e', '0e7a9a41-8da2-45de-b553-1acbf9cee3dc', 'bfa9b560-4973-490f-8cf2-98f8b2d72592'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7430c3dd-2659-41e1-98ea-bc6f99111aa6 tempest-GroupSnapshotsV319Test-2078663151 None] group_snapshot 30c24e9c-bb4a-40f9-b96b-c2ea041696b1: deleted successfully Nov 02 12:35:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f016170-5a03-4203-aadc-2c4ea2d1d286]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:04 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 Nov 02 12:35:04 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:04 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8" returned: 0 in 0.949s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:04 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8 Nov 02 12:35:04 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:05 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e2bba3b-7665-42d8-a266-0324721fd3f8" returned: 0 in 0.564s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "cinder-quobyte-2e2bba3b-7665-42d8-a266-0324721fd3f8" released by "delete_volume" :: held 1.684s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Created reservations ['31935e66-c5ed-4230-9fa2-d99c92057e93'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:05 devstack cinder-volume[86731]: WARNING cinder.quota [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1952216054 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1952216054, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:35:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Created reservations ['165b9141-22da-41ca-b49b-c5081358f699', 'd5d6ceb4-dbd9-4ae3-a1ee-4c4f38e11e08', '88d3b3b8-56e2-4b81-a940-73024966b16f', '4a9f45a9-6f46-47fb-b940-ea0fa561472c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:06 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:35:06 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Flow 'volume_create_manager' (4ea43c09-0f26-4a82-a102-a325586e12dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d47e5a-5a81-4e8f-a257-36c39538cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97d47e5a-5a81-4e8f-a257-36c39538cd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-690588997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feabbc0-9b6d-48be-8d8b-f147ad8a774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e252584b174f4dee837d226870c00f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:06Z,use_quota=True,user_id='df52998465c44d639a4bbff68961cbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40779d7b-1400-4214-a7f5-5027103daa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40779d7b-1400-4214-a7f5-5027103daa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39baa0b-9f6b-4d41-b8c4-6716190c2a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39baa0b-9f6b-4d41-b8c4-6716190c2a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5feabbc0-9b6d-48be-8d8b-f147ad8a774a', 'volume_name': 'volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89954758-5550-4e83-a85a-f8d38873b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89954758-5550-4e83-a85a-f8d38873b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad89764-e9d4-495e-88fc-0111cafbcdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Volume 5feabbc0-9b6d-48be-8d8b-f147ad8a774a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a', 'volume_size': 1} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-690588997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feabbc0-9b6d-48be-8d8b-f147ad8a774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e252584b174f4dee837d226870c00f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:06Z,use_quota=True,user_id='df52998465c44d639a4bbff68961cbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Creating volume 5feabbc0-9b6d-48be-8d8b-f147ad8a774a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:35:06 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:35:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:06 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a 1073741824 Nov 02 12:35:06 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:07 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.793s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-81e93f55-3b0e-4149-a07c-379464d70477 tempest-GroupSnapshotsV319Test-2078663151 None] Delete group completed successfully. Nov 02 12:35:07 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a 1073741824" returned: 0 in 1.066s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:07 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a Nov 02 12:35:07 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:08 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad89764-e9d4-495e-88fc-0111cafbcdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2d0b87-1410-406b-80b6-22615cce4de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Volume volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a (5feabbc0-9b6d-48be-8d8b-f147ad8a774a): created successfully Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2d0b87-1410-406b-80b6-22615cce4de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Flow 'volume_create_manager' (4ea43c09-0f26-4a82-a102-a325586e12dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0c7e7c66-c008-4ad1-9f2c-0f9d53add984 tempest-VolumesAdminNegativeTest-185440717 None] Created volume successfully. Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Acquiring lock "cinder-5feabbc0-9b6d-48be-8d8b-f147ad8a774a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "cinder-5feabbc0-9b6d-48be-8d8b-f147ad8a774a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Acquiring lock "cinder-quobyte-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "cinder-quobyte-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6beff26-952d-4f5c-9fa3-4e1775204938]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:10 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a Nov 02 12:35:10 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:11 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" returned: 0 in 0.770s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:11 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a Nov 02 12:35:11 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:11 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" returned: 0 in 0.591s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "cinder-quobyte-5feabbc0-9b6d-48be-8d8b-f147ad8a774a" released by "delete_volume" :: held 1.458s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:11 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:35:11 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:35:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Created reservations ['825c569a-7d55-4e63-922e-39db1b1122ed', '0666f2f7-aed1-4bc6-befe-a70095536c0e', '797ffd27-6bc2-485b-8574-5563ae4ab053', 'a1794984-461f-4148-bda6-3b56213a0741'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:12 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:35:12 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:12 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Deleted volume successfully. Nov 02 12:35:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2dd61ce5-209c-46fe-9ffa-4913049060a7 tempest-VolumesAdminNegativeTest-185440717 None] Lock "cinder-5feabbc0-9b6d-48be-8d8b-f147ad8a774a-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-200f78df-0320-4c35-b2b7-721a50393ed1 tempest-GroupsV320Test-1722266452 None] Group tempest-GroupsV320Test-Group-1503836842: creating Nov 02 12:35:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-200f78df-0320-4c35-b2b7-721a50393ed1 tempest-GroupsV320Test-1722266452 None] Group tempest-GroupsV320Test-Group-1503836842: created successfully Nov 02 12:35:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-200f78df-0320-4c35-b2b7-721a50393ed1 tempest-GroupsV320Test-1722266452 None] Create group completed successfully. Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Created reservations ['0d4dc013-8fb3-439b-88e5-8899df788da5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:23 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:35:23 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:24 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-93dc1b7e-e27f-47ce-9124-86317fb4858a tempest-GroupsV320Test-1722266452 None] Delete group completed successfully. Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:28 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:35:28 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:29 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:35:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 8 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:35:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:35:33 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=45,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:33 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Flow 'volume_create_manager' (0ce39981-a793-48ab-9f7b-7a4997497dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7346bc12-52a1-4f02-9b9f-a29aa4a5cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7346bc12-52a1-4f02-9b9f-a29aa4a5cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1640340355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e6601-70cd-4edc-97da-638c8a9c233b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d59ee9fbdc45adbf094cfdcd6ea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:46Z,use_quota=True,user_id='f3afd013326b4e10b063487605a964bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd71c8e-dc6f-4aa1-aa02-865b46e1983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd71c8e-dc6f-4aa1-aa02-865b46e1983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cd6bf-c5e5-42e1-96ef-d7e53521ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cd6bf-c5e5-42e1-96ef-d7e53521ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876e6601-70cd-4edc-97da-638c8a9c233b', 'volume_name': 'volume-876e6601-70cd-4edc-97da-638c8a9c233b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb4e3f-ee24-4cd3-b66f-f391fac4cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb4e3f-ee24-4cd3-b66f-f391fac4cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afe45ac-543c-4532-9eb9-1768c007178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Volume 876e6601-70cd-4edc-97da-638c8a9c233b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876e6601-70cd-4edc-97da-638c8a9c233b', 'volume_size': 1} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1640340355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e6601-70cd-4edc-97da-638c8a9c233b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d59ee9fbdc45adbf094cfdcd6ea6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:46Z,use_quota=True,user_id='f3afd013326b4e10b063487605a964bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Creating volume 876e6601-70cd-4edc-97da-638c8a9c233b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:35:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:35:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:45 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b 1073741824 Nov 02 12:35:45 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:46 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b 1073741824" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:46 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b Nov 02 12:35:46 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:47 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b" returned: 0 in 0.610s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1afe45ac-543c-4532-9eb9-1768c007178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876e6601-70cd-4edc-97da-638c8a9c233b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e89d7f-0f28-4d63-a7b9-48afcae58586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Volume volume-876e6601-70cd-4edc-97da-638c8a9c233b (876e6601-70cd-4edc-97da-638c8a9c233b): created successfully Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e89d7f-0f28-4d63-a7b9-48afcae58586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Flow 'volume_create_manager' (0ce39981-a793-48ab-9f7b-7a4997497dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-45f1e8af-b0a6-4fb5-a3bd-a168441b5702 tempest-VolumesServicesTestJSON-2142367334 None] Created volume successfully. Nov 02 12:35:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Acquiring lock "cinder-876e6601-70cd-4edc-97da-638c8a9c233b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "cinder-876e6601-70cd-4edc-97da-638c8a9c233b-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Acquiring lock "cinder-quobyte-876e6601-70cd-4edc-97da-638c8a9c233b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "cinder-quobyte-876e6601-70cd-4edc-97da-638c8a9c233b" acquired by "delete_volume" :: waited 0.060s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c8906b-1536-4165-a175-715f2d7c8584]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:49 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b Nov 02 12:35:49 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:50 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b" returned: 0 in 1.047s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:50 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b Nov 02 12:35:50 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:50 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-876e6601-70cd-4edc-97da-638c8a9c233b" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "cinder-quobyte-876e6601-70cd-4edc-97da-638c8a9c233b" released by "delete_volume" :: held 1.783s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Created reservations ['505ad6b9-edc7-46bd-b81c-6b75a8a2145c', '39d62e81-dd10-47e7-bf47-94b9bd09fb52', '43da5850-4bd0-4683-af16-964ffb6c9b26', '83e94b3b-235b-4597-b79e-8fd2f3b3ec28'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:51 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:35:51 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:52 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.789s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:52 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Deleted volume successfully. Nov 02 12:35:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eea1e3af-da60-4637-a258-f32cd627644b tempest-VolumesServicesTestJSON-2142367334 None] Lock "cinder-876e6601-70cd-4edc-97da-638c8a9c233b-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:57 devstack cinder-volume[86731]: WARNING py.warnings [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 02 12:35:57 devstack cinder-volume[86731]: .first() Nov 02 12:35:57 devstack cinder-volume[86731]: Nov 02 12:35:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a182841a-8469-4b97-97ad-31273305b882', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:35:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-56f3029b-9d0b-4beb-a54d-c61ce7438cb5 req-51e0c704-3394-4be3-88ad-fa92b3fbd06d tempest-TaggedAttachmentsTest-2099024037 None] attachment_update completed successfully. Nov 02 12:36:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-1838e92d-c1fc-433d-9a92-c65fa9b66692 req-868cc28a-04c9-49f3-9a65-803f62e638fc tempest-TaggedAttachmentsTest-2099024037 None] Terminate volume connection completed successfully. Nov 02 12:36:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-1838e92d-c1fc-433d-9a92-c65fa9b66692 req-868cc28a-04c9-49f3-9a65-803f62e638fc tempest-TaggedAttachmentsTest-2099024037 None] Deleting attachment a182841a-8469-4b97-97ad-31273305b882. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:36:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:36:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Flow 'volume_create_manager' (8efb2e97-6d8e-43c0-a4d7-596697c677b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6426d20-4b32-47c4-ad7d-0711c0c2b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6426d20-4b32-47c4-ad7d-0711c0c2b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-409849664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d27aae-0536-4749-b5ae-3873d81f402b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dc6744ca7143eb8985f4d74c89392b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:07Z,use_quota=True,user_id='5828be0f41034a8c99254fdfd343470b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a45b95-84a0-44c8-acba-d618b2019739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a45b95-84a0-44c8-acba-d618b2019739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c6b37c-6a08-4410-966e-3b82a9f8989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c6b37c-6a08-4410-966e-3b82a9f8989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d27aae-0536-4749-b5ae-3873d81f402b', 'volume_name': 'volume-e3d27aae-0536-4749-b5ae-3873d81f402b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82240beb-4b51-4184-9448-f798ff46a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82240beb-4b51-4184-9448-f798ff46a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0881fb1-13f3-4a16-95cb-6475dc86edfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Volume e3d27aae-0536-4749-b5ae-3873d81f402b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d27aae-0536-4749-b5ae-3873d81f402b', 'volume_size': 1} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-409849664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d27aae-0536-4749-b5ae-3873d81f402b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dc6744ca7143eb8985f4d74c89392b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:07Z,use_quota=True,user_id='5828be0f41034a8c99254fdfd343470b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Creating volume e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:07 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b 1073741824 Nov 02 12:36:07 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:07 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b 1073741824" returned: 0 in 0.738s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:07 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b Nov 02 12:36:07 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Flow 'volume_create_manager' (21b68d66-560a-4a03-a9b0-43c81893c99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6b1eed-0f50-4711-aa19-c6811247a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6b1eed-0f50-4711-aa19-c6811247a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-502612171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35832d65b79941af8c4096596236d85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:08Z,use_quota=True,user_id='ecd0188b45c845d387ab551b76f024b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a03cf-c207-41c3-ac98-0e96b9e751cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a03cf-c207-41c3-ac98-0e96b9e751cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42246783-ecdd-489a-bc4d-33c3341b9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42246783-ecdd-489a-bc4d-33c3341b9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4', 'volume_name': 'volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd55e5fd-0b4c-4ada-8ba9-7c84f7d933af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd55e5fd-0b4c-4ada-8ba9-7c84f7d933af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca5ba34-5885-47e0-bb50-6b91d05c7b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Volume ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4', 'volume_size': 1} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:08 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-502612171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35832d65b79941af8c4096596236d85e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:08Z,use_quota=True,user_id='ecd0188b45c845d387ab551b76f024b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Creating volume ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0881fb1-13f3-4a16-95cb-6475dc86edfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d27aae-0536-4749-b5ae-3873d81f402b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b627c-d963-46d4-9d6e-544c53ab09fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Volume volume-e3d27aae-0536-4749-b5ae-3873d81f402b (e3d27aae-0536-4749-b5ae-3873d81f402b): created successfully Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813b627c-d963-46d4-9d6e-544c53ab09fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:08 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 1073741824 Nov 02 12:36:08 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Flow 'volume_create_manager' (8efb2e97-6d8e-43c0-a4d7-596697c677b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-af05d498-9a21-43d9-bfaa-0a08a17a1158 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Created volume successfully. Nov 02 12:36:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 1073741824" returned: 0 in 1.143s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:09 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:09 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 Nov 02 12:36:09 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:10 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" returned: 0 in 0.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca5ba34-5885-47e0-bb50-6b91d05c7b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdd1a17-5507-45bd-b0a6-a4131a1119c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Creating offline snapshot 7123e57b-4342-46cf-90f6-6de3fb7f6871 of volume e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:36:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Volume volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 (ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4): created successfully Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdd1a17-5507-45bd-b0a6-a4131a1119c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Flow 'volume_create_manager' (21b68d66-560a-4a03-a9b0-43c81893c99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8240a7d3-e8b0-4226-b9b4-3b5dea219d1b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2b3bd40d-f390-4fb6-bac0-cf599a0e5dc1 tempest-ServerRescueNegativeTestJSON-2026657222 None] Created volume successfully. Nov 02 12:36:10 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b Nov 02 12:36:10 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:10 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b" returned: 0 in 0.655s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:10 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 1G Nov 02 12:36:10 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:11 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 1G" returned: 0 in 0.796s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d27aae-0536-4749-b5ae-3873d81f402b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:11 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d27aae-0536-4749-b5ae-3873d81f402b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 Nov 02 12:36:11 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:12 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d27aae-0536-4749-b5ae-3873d81f402b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871" returned: 0 in 0.766s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:12 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 is being set with open permissions: ugo+rw Nov 02 12:36:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:12 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 Nov 02 12:36:12 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:13 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871" returned: 0 in 0.850s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:13 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info Nov 02 12:36:13 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:14 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info is being set with open permissions: ugo+rw Nov 02 12:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:14 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info Nov 02 12:36:14 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:14 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.info" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fb627de-539e-4c2e-bc42-1fb678744fa6 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Create snapshot completed successfully Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "cinder-7123e57b-4342-46cf-90f6-6de3fb7f6871-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-7123e57b-4342-46cf-90f6-6de3fb7f6871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "cinder-quobyte-7123e57b-4342-46cf-90f6-6de3fb7f6871" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-7123e57b-4342-46cf-90f6-6de3fb7f6871" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Deleting offline snapshot 7123e57b-4342-46cf-90f6-6de3fb7f6871 of volume e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] snapshot_file for this snap is: volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c58c9-c48f-40b0-a776-6f40f8642383]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:16 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 Nov 02 12:36:16 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:17 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871" returned: 0 in 0.704s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d27aae-0536-4749-b5ae-3873d81f402b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[27589bc9-a276-4863-b73a-ef5e0ba8e7c5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:17 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b Nov 02 12:36:17 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:17 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b" returned: 0 in 0.627s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:17 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 Nov 02 12:36:17 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:18 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871" returned: 0 in 0.676s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:18 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871 Nov 02 12:36:18 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:18 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b.7123e57b-4342-46cf-90f6-6de3fb7f6871" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-7123e57b-4342-46cf-90f6-6de3fb7f6871" released by "_delete_snapshot" :: held 2.782s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" released by "delete_snapshot" :: held 2.836s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:19 devstack cinder-volume[86731]: WARNING cinder.quota [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Created reservations ['7d6bed20-e2b7-4339-a5dd-84188ca0b166', '2d8f2113-aefc-47a4-b414-e351dc309623', '99c7930b-14e9-4ffc-80a1-e21e29aa1827', '76638d72-24c8-42e9-865c-3565599e43d9'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Delete snapshot completed successfully. Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-334d0fb8-e4b5-45b2-8658-5712ca924244 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-7123e57b-4342-46cf-90f6-6de3fb7f6871-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "cinder-e3d27aae-0536-4749-b5ae-3873d81f402b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-e3d27aae-0536-4749-b5ae-3873d81f402b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f7f9a-c8c5-4fb2-97d3-624c64a36c73]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b Nov 02 12:36:20 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b Nov 02 12:36:20 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e3d27aae-0536-4749-b5ae-3873d81f402b" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-quobyte-e3d27aae-0536-4749-b5ae-3873d81f402b" released by "delete_volume" :: held 1.150s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Created reservations ['7b977f8a-272b-400e-b1d9-3c8757461ada', '248852af-7b38-46d5-a715-6185f1fb3717', 'a85b660b-0d79-41b2-b668-8e1b3d65b9b6', 'abab5545-f318-4ad1-9f42-85ae0f9200c2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:21 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:21 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:21 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Deleted volume successfully. Nov 02 12:36:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c49f6b27-c349-4df8-a815-0fa73cb96075 tempest-VolumeSnapshotQuotasNegativeTestJSON-307363493 None] Lock "cinder-e3d27aae-0536-4749-b5ae-3873d81f402b-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "cinder-abffb723-d1ee-4b15-bdb3-7010e88ea29f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "cinder-abffb723-d1ee-4b15-bdb3-7010e88ea29f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "cinder-quobyte-abffb723-d1ee-4b15-bdb3-7010e88ea29f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "cinder-quobyte-abffb723-d1ee-4b15-bdb3-7010e88ea29f" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e586876-1ae4-4964-83f9-d19ebdbf0f64]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:24 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f Nov 02 12:36:24 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:24 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:24 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f Nov 02 12:36:24 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:25 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-abffb723-d1ee-4b15-bdb3-7010e88ea29f" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "cinder-quobyte-abffb723-d1ee-4b15-bdb3-7010e88ea29f" released by "delete_volume" :: held 1.010s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Created reservations ['af7b8596-8e53-462b-bd81-3cbe34ddc4f1', 'dbbe1089-37fd-481a-9857-fd09eab6d2a8', '8c50eaa5-1a74-4bbd-a7ee-2d41848c295a', 'a7f51911-bd72-4c7f-9918-631cfd96d619'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:25 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:25 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:25 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Deleted volume successfully. Nov 02 12:36:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-67828bea-e3e8-4236-a8c7-a2e201481ef2 tempest-TaggedAttachmentsTest-2099024037 None] Lock "cinder-abffb723-d1ee-4b15-bdb3-7010e88ea29f-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:28 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:28 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:29 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.613s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Acquiring lock "cinder-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "cinder-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Acquiring lock "cinder-quobyte-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "cinder-quobyte-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3151876-4927-4a9a-99f5-50b50834c57f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:30 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 Nov 02 12:36:30 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:31 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" returned: 0 in 0.924s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:31 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4 Nov 02 12:36:31 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" returned: 0 in 0.809s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "cinder-quobyte-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4" released by "delete_volume" :: held 1.841s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Flow 'volume_create_manager' (f097f1d4-f745-4250-b09e-a187bcefbe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b7c42d-e609-4795-b19d-aa07dba9c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Created reservations ['61a041f7-7758-43e9-9716-545a8a0a4673', 'b63875a8-2b48-4ee7-a13f-eee6698778f8', 'b85de48b-f8a9-4d60-bcb5-ab3d9ee0bbaa', '33fef115-01ba-462b-b416-ad90128f0d63'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b7c42d-e609-4795-b19d-aa07dba9c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-164737210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75b6dc8-c8b8-446a-99a6-71b0b08284d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98e63d3ffe2406ca485654a17f081e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:32Z,use_quota=True,user_id='e897d50a4f574dea8981b500f69adf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bff6f3-1346-407f-8f61-31726eb8723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bff6f3-1346-407f-8f61-31726eb8723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658dd3ee-54f6-4f81-804e-31787acd8ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658dd3ee-54f6-4f81-804e-31787acd8ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75b6dc8-c8b8-446a-99a6-71b0b08284d2', 'volume_name': 'volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c8a31-4220-4cdd-8517-bfa4a71fa92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50c8a31-4220-4cdd-8517-bfa4a71fa92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9986cda9-d042-4499-a96b-16a2ffdcf1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Volume c75b6dc8-c8b8-446a-99a6-71b0b08284d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2', 'volume_size': 1} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-164737210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75b6dc8-c8b8-446a-99a6-71b0b08284d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98e63d3ffe2406ca485654a17f081e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:32Z,use_quota=True,user_id='e897d50a4f574dea8981b500f69adf46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Creating volume c75b6dc8-c8b8-446a-99a6-71b0b08284d2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 1073741824 Nov 02 12:36:32 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:32 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:33 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Deleted volume successfully. Nov 02 12:36:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3a02dbc5-5099-45b8-8be3-120017f616e2 tempest-ServerRescueNegativeTestJSON-2026657222 None] Lock "cinder-ef7bec0d-a5b8-4b28-8d31-cebdeb833fa4-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:33 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 1073741824" returned: 0 in 1.063s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:33 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 Nov 02 12:36:33 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:34 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" returned: 0 in 1.059s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9986cda9-d042-4499-a96b-16a2ffdcf1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d60519-5e88-44a4-a8a6-545bf71efd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Volume volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 (c75b6dc8-c8b8-446a-99a6-71b0b08284d2): created successfully Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d60519-5e88-44a4-a8a6-545bf71efd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Flow 'volume_create_manager' (f097f1d4-f745-4250-b09e-a187bcefbe79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3ff41c42-68e2-4cb3-9d8f-5f4ca1b1d031 tempest-DeleteServersTestJSON-1637366070 None] Created volume successfully. Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-423d210e-9c10-4faf-94d1-7ec157454a63 req-a10d5708-a333-4f06-a571-6e39217a2b66 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-423d210e-9c10-4faf-94d1-7ec157454a63 req-a10d5708-a333-4f06-a571-6e39217a2b66 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Flow 'volume_create_manager' (63abdbc0-19d7-47e0-aaea-9cf64514c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a094e926-1acc-49e3-a8fe-b5483b4610af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-423d210e-9c10-4faf-94d1-7ec157454a63 req-a10d5708-a333-4f06-a571-6e39217a2b66 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.123s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a094e926-1acc-49e3-a8fe-b5483b4610af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-993203058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c67b87-8d4b-4554-8ffe-dbac51baf8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d99095de9545ceaf986fb9c39e79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:38Z,use_quota=True,user_id='5aa0b13b0b004a6d8dca2fe5a1cbc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde7f1bc-bd3f-4440-a66f-788ed1ab1008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde7f1bc-bd3f-4440-a66f-788ed1ab1008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aef682-a766-4e63-b154-c2fa030ee025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85aef682-a766-4e63-b154-c2fa030ee025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c67b87-8d4b-4554-8ffe-dbac51baf8c6', 'volume_name': 'volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8796c22-6530-4347-93da-9b429efb0e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8796c22-6530-4347-93da-9b429efb0e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4872a97-490e-4bfd-bba3-f27bd5059856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:38 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Volume 51c67b87-8d4b-4554-8ffe-dbac51baf8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6', 'volume_size': 1} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-993203058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c67b87-8d4b-4554-8ffe-dbac51baf8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49d99095de9545ceaf986fb9c39e79bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:38Z,use_quota=True,user_id='5aa0b13b0b004a6d8dca2fe5a1cbc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Creating volume 51c67b87-8d4b-4554-8ffe-dbac51baf8c6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:38 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:38 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 1073741824 Nov 02 12:36:38 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-423d210e-9c10-4faf-94d1-7ec157454a63 req-a10d5708-a333-4f06-a571-6e39217a2b66 tempest-DeleteServersTestJSON-1637366070 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82a40279-7a38-4f39-a799-fd4aebf6bdd2', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:36:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-423d210e-9c10-4faf-94d1-7ec157454a63 req-a10d5708-a333-4f06-a571-6e39217a2b66 tempest-DeleteServersTestJSON-1637366070 None] attachment_update completed successfully. Nov 02 12:36:39 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 1073741824" returned: 0 in 1.040s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:39 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 Nov 02 12:36:39 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:39 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4872a97-490e-4bfd-bba3-f27bd5059856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d79423-6099-4137-a362-310e5003ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Volume volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 (51c67b87-8d4b-4554-8ffe-dbac51baf8c6): created successfully Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d79423-6099-4137-a362-310e5003ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Flow 'volume_create_manager' (63abdbc0-19d7-47e0-aaea-9cf64514c606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c2d7e6a5-1d45-4d76-9e2a-c80b862424b6 tempest-AbsoluteLimitsTests-689832263 None] Created volume successfully. Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Acquiring lock "cinder-51c67b87-8d4b-4554-8ffe-dbac51baf8c6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "cinder-51c67b87-8d4b-4554-8ffe-dbac51baf8c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Acquiring lock "cinder-quobyte-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "cinder-quobyte-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f2f3c6-c0f7-4224-b9f2-fbc715164dd0]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:41 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 Nov 02 12:36:41 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:42 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" returned: 0 in 0.640s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:42 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6 Nov 02 12:36:42 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:42 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" returned: 0 in 0.403s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "cinder-quobyte-51c67b87-8d4b-4554-8ffe-dbac51baf8c6" released by "delete_volume" :: held 1.169s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Created reservations ['fa23f6c4-2c77-4c74-857d-8a746686e255', '302c8f7e-81d9-404a-8e42-602aa35c666a', 'c17d6487-333d-4449-9ea2-9e84031e7dae', '0d640aeb-aeaf-4f86-8e41-880ba20b575f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:43 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:43 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:43 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Deleted volume successfully. Nov 02 12:36:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2b35ecf9-2f43-4d6f-b6e0-e147feff866b tempest-AbsoluteLimitsTests-689832263 None] Lock "cinder-51c67b87-8d4b-4554-8ffe-dbac51baf8c6-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=69,cinder:SELECT=59,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:36:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=60,cinder:INSERT=20,cinder:UPDATE=62,cinder:DELETE=7 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:36:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-e73509ef-0fa5-48ea-857f-95414b4bc563 req-ad45673e-011f-4e1b-b621-9799933c513b tempest-DeleteServersTestJSON-1637366070 None] Terminate volume connection completed successfully. Nov 02 12:36:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-e73509ef-0fa5-48ea-857f-95414b4bc563 req-ad45673e-011f-4e1b-b621-9799933c513b tempest-DeleteServersTestJSON-1637366070 None] Deleting attachment 82a40279-7a38-4f39-a799-fd4aebf6bdd2. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "cinder-c75b6dc8-c8b8-446a-99a6-71b0b08284d2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "cinder-c75b6dc8-c8b8-446a-99a6-71b0b08284d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "cinder-quobyte-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "cinder-quobyte-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13e502-c993-4235-ac34-d8e355c4ca72]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:48 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 Nov 02 12:36:48 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:48 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:48 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2 Nov 02 12:36:48 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:49 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "cinder-quobyte-c75b6dc8-c8b8-446a-99a6-71b0b08284d2" released by "delete_volume" :: held 0.855s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Created reservations ['799ea208-6f15-4905-bfac-8eb190717caa', '34b891b9-7e7c-4e39-ba51-475ddd951a89', 'ae4c3ce5-6a68-4bcb-9b41-ede9d279a90d', '127277e1-8acb-4027-ac4d-70ce021df70e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:49 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:49 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:49 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Deleted volume successfully. Nov 02 12:36:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b19af09d-9794-4059-ae8a-057b04404f01 tempest-DeleteServersTestJSON-1637366070 None] Lock "cinder-c75b6dc8-c8b8-446a-99a6-71b0b08284d2-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Flow 'volume_create_manager' (b3b06d6c-eaa3-4d5b-b6b3-d9829cec7c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d408b740-1602-4222-b702-404880c77ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d408b740-1602-4222-b702-404880c77ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-506513787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c44e73a-421f-40a4-9142-60dfa9608333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e6dfce3a4d4db98d8da40afde332e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:54Z,use_quota=True,user_id='3e362e60cdcd40bcbffd18b1a113ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eb92ed-47ae-449b-bb8c-cf112565a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7eb92ed-47ae-449b-bb8c-cf112565a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad64872-7a14-4961-b5d6-a2e8feb86e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad64872-7a14-4961-b5d6-a2e8feb86e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c44e73a-421f-40a4-9142-60dfa9608333', 'volume_name': 'volume-2c44e73a-421f-40a4-9142-60dfa9608333', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9778283-872f-469d-ad78-52ac33a48f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9778283-872f-469d-ad78-52ac33a48f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad4bf8e-d864-4636-80a3-eb44931a0602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Volume 2c44e73a-421f-40a4-9142-60dfa9608333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c44e73a-421f-40a4-9142-60dfa9608333', 'volume_size': 1} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-506513787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c44e73a-421f-40a4-9142-60dfa9608333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e6dfce3a4d4db98d8da40afde332e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:54Z,use_quota=True,user_id='3e362e60cdcd40bcbffd18b1a113ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Creating volume 2c44e73a-421f-40a4-9142-60dfa9608333 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:36:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:54 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 1073741824 Nov 02 12:36:54 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:55 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 1073741824" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:55 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 Nov 02 12:36:55 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:55 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad4bf8e-d864-4636-80a3-eb44931a0602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c44e73a-421f-40a4-9142-60dfa9608333', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877a162a-d2d8-46e3-acbb-4bc16b470146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Volume volume-2c44e73a-421f-40a4-9142-60dfa9608333 (2c44e73a-421f-40a4-9142-60dfa9608333): created successfully Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877a162a-d2d8-46e3-acbb-4bc16b470146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Flow 'volume_create_manager' (b3b06d6c-eaa3-4d5b-b6b3-d9829cec7c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-985cf719-8e30-40f2-86e7-0269dc9070b4 tempest-VolumesTransfersTest-104369963 None] Created volume successfully. Nov 02 12:36:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9a139cf3-100c-499f-b525-9d88246cf014 tempest-VolumesTransfersTest-1343635644 None] Transfer volume completed successfully. Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "cinder-2c44e73a-421f-40a4-9142-60dfa9608333-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-2c44e73a-421f-40a4-9142-60dfa9608333-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "cinder-quobyte-2c44e73a-421f-40a4-9142-60dfa9608333" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-quobyte-2c44e73a-421f-40a4-9142-60dfa9608333" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61015e7-9962-44f4-8f18-74416e638956]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:58 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 Nov 02 12:36:58 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:59 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:59 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333 Nov 02 12:36:59 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:59 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2c44e73a-421f-40a4-9142-60dfa9608333" returned: 0 in 0.297s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-quobyte-2c44e73a-421f-40a4-9142-60dfa9608333" released by "delete_volume" :: held 0.787s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Created reservations ['dc4ee022-1854-4749-9467-1740633e47f1', '718b90c4-026d-45fb-8d89-83a7c4399c0c', 'ec18b659-bcbc-452f-8021-643dd407eea7', '1642b5ea-e854-4230-89bd-57fc4b848058'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:59 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:36:59 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:00 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Deleted volume successfully. Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1ec531-d969-4ceb-a2fc-6beebe84978d tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-2c44e73a-421f-40a4-9142-60dfa9608333-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Flow 'volume_create_manager' (98a94782-61ca-4c0f-90d4-dbdaab3e6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fd9066-0d47-4807-bcba-b7a002be4917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fd9066-0d47-4807-bcba-b7a002be4917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-405676889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e6dfce3a4d4db98d8da40afde332e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:01Z,use_quota=True,user_id='3e362e60cdcd40bcbffd18b1a113ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf9b9c-b2f6-4b34-b311-37465db88a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf9b9c-b2f6-4b34-b311-37465db88a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d9fff-e71c-428b-932d-9cdd305641b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5d9fff-e71c-428b-932d-9cdd305641b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0', 'volume_name': 'volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3b613-6fef-4518-887a-027f79dd4954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3b613-6fef-4518-887a-027f79dd4954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe78ca4-1eeb-480e-a81b-c0cdb03a4a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Volume b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0', 'volume_size': 1} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-405676889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e6dfce3a4d4db98d8da40afde332e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:01Z,use_quota=True,user_id='3e362e60cdcd40bcbffd18b1a113ee0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Creating volume b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:00 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:00 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 1073741824 Nov 02 12:37:00 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:01 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 1073741824" returned: 0 in 0.638s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:01 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 Nov 02 12:37:01 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:02 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe78ca4-1eeb-480e-a81b-c0cdb03a4a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89385ceb-44b5-4fd0-b276-977a9e4b31a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Volume volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 (b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0): created successfully Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89385ceb-44b5-4fd0-b276-977a9e4b31a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Flow 'volume_create_manager' (98a94782-61ca-4c0f-90d4-dbdaab3e6195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d2f6a703-9502-44e3-90b6-45274df2222a tempest-VolumesTransfersTest-104369963 None] Created volume successfully. Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Flow 'volume_create_manager' (6aa5ab17-3a9d-4584-8637-c36f49db57d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f069c9dd-18b5-4f93-ba30-0aa9fc5d3a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f069c9dd-18b5-4f93-ba30-0aa9fc5d3a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1153838939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24a3cb5-4145-4142-8904-e55ffd58360c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec3d3329e9f4c19a4f76c86fa7ffbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:03Z,use_quota=True,user_id='5bad40c87ecd4a7aa39557d8e111aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2691941-1866-41bf-b483-44f9378f161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2691941-1866-41bf-b483-44f9378f161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133c2664-c746-481d-8004-11fb8258320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133c2664-c746-481d-8004-11fb8258320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24a3cb5-4145-4142-8904-e55ffd58360c', 'volume_name': 'volume-a24a3cb5-4145-4142-8904-e55ffd58360c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3a389-b6f8-48c4-9fec-b3c62a6e4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3a389-b6f8-48c4-9fec-b3c62a6e4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f20f1f0-cd11-4cf7-8cf6-281d22125706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Volume a24a3cb5-4145-4142-8904-e55ffd58360c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24a3cb5-4145-4142-8904-e55ffd58360c', 'volume_size': 1} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1153838939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24a3cb5-4145-4142-8904-e55ffd58360c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec3d3329e9f4c19a4f76c86fa7ffbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:03Z,use_quota=True,user_id='5bad40c87ecd4a7aa39557d8e111aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Creating volume a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:03 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c 1073741824 Nov 02 12:37:03 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "cinder-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "cinder-quobyte-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-quobyte-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd2c5a-cc45-4598-ab96-dda16962cf9d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:03 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 Nov 02 12:37:03 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:03 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c 1073741824" returned: 0 in 0.691s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:03 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c Nov 02 12:37:03 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:03 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:04 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0 Nov 02 12:37:04 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:04 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f20f1f0-cd11-4cf7-8cf6-281d22125706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24a3cb5-4145-4142-8904-e55ffd58360c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14826abe-0cd3-4c07-a24f-d9881e46ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Volume volume-a24a3cb5-4145-4142-8904-e55ffd58360c (a24a3cb5-4145-4142-8904-e55ffd58360c): created successfully Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14826abe-0cd3-4c07-a24f-d9881e46ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Flow 'volume_create_manager' (6aa5ab17-3a9d-4584-8637-c36f49db57d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-bfc9fc51-0ac6-448c-b7a3-dcc3844e4d10 req-db32b6cb-a1c7-4613-ad71-6d38b6e31398 tempest-VolumesSnapshotsTestJSON-1930159920 None] Created volume successfully. Nov 02 12:37:04 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-quobyte-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0" released by "delete_volume" :: held 0.940s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Created reservations ['1a2deaff-60c3-4e72-bb92-a030599c5869', 'c9ddc82f-4c6c-49c6-ae68-fafbf6182813', 'e8926034-bbb0-4dfb-bd4f-61f038794ffe', '92aa9465-cc0d-484c-802f-505290605f62'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:04 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:04 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:04 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Deleted volume successfully. Nov 02 12:37:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc8455c3-f694-47de-aac7-5ed28e94fcec tempest-VolumesTransfersTest-1127015391 None] Lock "cinder-b2ac2c5f-7e8a-4915-8a72-1d80fcc0a4d0-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Creating offline snapshot 4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 of volume a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:37:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b35984-cee1-4184-9ccc-d28c02274d7c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:05 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c Nov 02 12:37:05 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:06 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c" returned: 0 in 0.639s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:06 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 1G Nov 02 12:37:06 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:06 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 1G" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a3cb5-4145-4142-8904-e55ffd58360c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:06 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a3cb5-4145-4142-8904-e55ffd58360c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 Nov 02 12:37:06 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:07 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a3cb5-4145-4142-8904-e55ffd58360c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 is being set with open permissions: ugo+rw Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:07 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 Nov 02 12:37:07 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:07 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:07 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info Nov 02 12:37:07 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:07 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info is being set with open permissions: ugo+rw Nov 02 12:37:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:07 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info Nov 02 12:37:07 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:08 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.info" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-3d7fa204-52a5-4f2c-8d6e-f47144b8491a req-31aeeda3-3055-4b91-b050-39e52da8dc44 tempest-VolumesSnapshotsTestJSON-1930159920 None] Create snapshot completed successfully Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "cinder-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "cinder-quobyte-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Deleting offline snapshot 4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 of volume a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] snapshot_file for this snap is: volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4469cb7-3d79-4900-850b-35f7569bfa5e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:08 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 Nov 02 12:37:08 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:09 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24a3cb5-4145-4142-8904-e55ffd58360c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1faabf5-fc82-4900-9697-df2260a883ed]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:09 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c Nov 02 12:37:09 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:09 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:09 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 Nov 02 12:37:09 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:10 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:10 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0 Nov 02 12:37:10 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:10 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c.4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0" released by "_delete_snapshot" :: held 2.063s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" released by "delete_snapshot" :: held 2.100s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG cinder.quota [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Created reservations ['7f0d5ca0-5c8e-4f08-988e-588acf59b679', '1cc727d9-ebb8-4d14-bbc1-6e88f5651f50', 'bb3d0b6a-9468-4ef0-99a1-604fa287e76c', '55b64fb0-58e8-460f-b50b-6aa21e5a2169'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Delete snapshot completed successfully. Nov 02 12:37:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-1e13563a-3529-4952-815f-77801569aa06 req-c749694d-6912-4885-81c9-c7273a7fa703 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-4156d7ab-cf7b-43ce-8a4a-25bbf44284e0-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "cinder-a24a3cb5-4145-4142-8904-e55ffd58360c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-a24a3cb5-4145-4142-8904-e55ffd58360c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5537a-1d6d-4e51-a317-7e2d61665e87]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:12 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c Nov 02 12:37:12 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:12 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c" returned: 0 in 0.538s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:12 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c Nov 02 12:37:12 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:13 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a24a3cb5-4145-4142-8904-e55ffd58360c" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-quobyte-a24a3cb5-4145-4142-8904-e55ffd58360c" released by "delete_volume" :: held 0.970s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.quota [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Created reservations ['7e7a9107-22cb-44f3-8931-464ab72592bc', 'b3d63541-4f66-443d-b045-47bb4f3795aa', '50b9444a-615f-483f-bb72-981774b2af5f', '9ca7d5fb-bb33-4e2b-ae6e-037f060d33eb'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:13 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:13 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:13 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.manager [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Deleted volume successfully. Nov 02 12:37:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-8dad2dc1-49f6-4f78-9bfa-8179677d46c0 req-906ec04d-7b5a-40af-99a9-b24567cd14a8 tempest-VolumesSnapshotsTestJSON-1930159920 None] Lock "cinder-a24a3cb5-4145-4142-8904-e55ffd58360c-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Flow 'volume_create_manager' (fb4df60e-2226-4360-b512-7ea54907397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47150a7a-ac10-476b-8596-b4e7796290b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47150a7a-ac10-476b-8596-b4e7796290b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054987544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fda71c7-56d3-42ab-9c38-2c3ef8cf4980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ca25b908ff461a8c9a6c25a602a624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:17Z,use_quota=True,user_id='9fcca3e0cfe7496b81048625b719e80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f5e460-8121-48ec-9178-3884732a853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f5e460-8121-48ec-9178-3884732a853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2818f08a-b7d7-4fe1-bc70-822725d06dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2818f08a-b7d7-4fe1-bc70-822725d06dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fda71c7-56d3-42ab-9c38-2c3ef8cf4980', 'volume_name': 'volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5b873-362e-4dbc-abb3-ad6648059b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c5b873-362e-4dbc-abb3-ad6648059b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d4078-6958-40c4-a991-7de755896fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Volume 6fda71c7-56d3-42ab-9c38-2c3ef8cf4980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980', 'volume_size': 1} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1054987544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fda71c7-56d3-42ab-9c38-2c3ef8cf4980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ca25b908ff461a8c9a6c25a602a624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:17Z,use_quota=True,user_id='9fcca3e0cfe7496b81048625b719e80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Creating volume 6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:17 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:17 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 1073741824 Nov 02 12:37:17 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:18 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 1073741824" returned: 0 in 0.585s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:18 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 Nov 02 12:37:18 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:18 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d4078-6958-40c4-a991-7de755896fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0f84db-f9f5-4b7a-957e-0bd4dc569737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Volume volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 (6fda71c7-56d3-42ab-9c38-2c3ef8cf4980): created successfully Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0f84db-f9f5-4b7a-957e-0bd4dc569737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Flow 'volume_create_manager' (fb4df60e-2226-4360-b512-7ea54907397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ab6c6604-c4ef-47c8-9c7a-fb6cbcaff838 tempest-VolumesTransfersV357Test-1391915219 None] Created volume successfully. Nov 02 12:37:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e5d0189a-a530-4de9-81d4-7c1050dd8851 tempest-VolumesTransfersV357Test-1499708492 None] Transfer volume completed successfully. Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "cinder-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "cinder-quobyte-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-quobyte-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526be68-3ffe-4d60-b868-8fd58764978d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:22 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 Nov 02 12:37:22 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e63058a-f699-43ae-bedc-84ac3814061c tempest-GroupsV314Test-117547828 None] Group tempest-GroupsV314Test-Group-66287740: creating Nov 02 12:37:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e63058a-f699-43ae-bedc-84ac3814061c tempest-GroupsV314Test-117547828 None] Group tempest-GroupsV314Test-Group-66287740: created successfully Nov 02 12:37:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e63058a-f699-43ae-bedc-84ac3814061c tempest-GroupsV314Test-117547828 None] Create group completed successfully. Nov 02 12:37:23 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" returned: 0 in 0.804s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:23 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980 Nov 02 12:37:23 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:23 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-quobyte-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980" released by "delete_volume" :: held 1.320s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Created reservations ['bf73d507-ac19-464c-a3b8-8764007a290c', '89c851a3-a0b4-44b0-add4-f7bffe6ff1d8', '30c74be0-e7f2-4fd1-ad97-cf9d0e2efdb5', '4e3fc19c-bbc3-41ec-a788-7edf100088c7'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:24 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:24 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:24 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.723s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Deleted volume successfully. Nov 02 12:37:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fdfbeda-4009-4cc9-a8b9-19332cd08fdc tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-6fda71c7-56d3-42ab-9c38-2c3ef8cf4980-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Flow 'volume_create_manager' (09d12952-7647-4605-9fe9-3406c96442d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d32669-c830-4667-96e2-2d9b3f22b818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d32669-c830-4667-96e2-2d9b3f22b818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248217110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cbf43d7-4cc5-4e6b-8575-ab8847e77084,host='devstack@QuobyteHD#QuobyteHD',id=b59ab3c9-263f-4201-8304-8fa81ac940fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca5f5c87b494e91851510ba54829288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:27Z,use_quota=True,user_id='9a79c0fa450f439cbcd390798781ad73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4350de46-fb9a-4b07-9ba6-bbf612f945f7),volume_type_id=4350de46-fb9a-4b07-9ba6-bbf612f945f7)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0971dd27-64c5-4097-b876-534a035222fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0971dd27-64c5-4097-b876-534a035222fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895cf2b-1d05-4921-80f4-42b7e60f388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0895cf2b-1d05-4921-80f4-42b7e60f388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59ab3c9-263f-4201-8304-8fa81ac940fc', 'volume_name': 'volume-b59ab3c9-263f-4201-8304-8fa81ac940fc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31352676-bc3d-49fe-9fe9-d67362c3d1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31352676-bc3d-49fe-9fe9-d67362c3d1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863525f4-9049-44a8-8b62-40ce88937141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Volume b59ab3c9-263f-4201-8304-8fa81ac940fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59ab3c9-263f-4201-8304-8fa81ac940fc', 'volume_size': 1} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cbf43d7-4cc5-4e6b-8575-ab8847e77084,created_at=2026-11-02T11:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248217110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cbf43d7-4cc5-4e6b-8575-ab8847e77084,host='devstack@QuobyteHD#QuobyteHD',id=b59ab3c9-263f-4201-8304-8fa81ac940fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca5f5c87b494e91851510ba54829288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:27Z,use_quota=True,user_id='9a79c0fa450f439cbcd390798781ad73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4350de46-fb9a-4b07-9ba6-bbf612f945f7),volume_type_id=4350de46-fb9a-4b07-9ba6-bbf612f945f7)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Creating volume b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:27 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc 1073741824 Nov 02 12:37:27 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Flow 'volume_create_manager' (c46c9fd9-3526-49d9-8682-1978d30f453b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590141fe-2f88-486b-ad8f-20b1f1cb62d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590141fe-2f88-486b-ad8f-20b1f1cb62d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1502955262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047425ac-9b3a-4fb3-8025-92bec850c1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ca25b908ff461a8c9a6c25a602a624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:27Z,use_quota=True,user_id='9fcca3e0cfe7496b81048625b719e80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8552e667-3a0f-47af-9fc2-87a8fe50b1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8552e667-3a0f-47af-9fc2-87a8fe50b1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4d9021-952f-4565-9a34-3c6fb7ef29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4d9021-952f-4565-9a34-3c6fb7ef29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047425ac-9b3a-4fb3-8025-92bec850c1ad', 'volume_name': 'volume-047425ac-9b3a-4fb3-8025-92bec850c1ad', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020f8139-0f7b-4410-a704-08380eab43e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020f8139-0f7b-4410-a704-08380eab43e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda7da10-9f68-4eed-a593-26d3f65e72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Volume 047425ac-9b3a-4fb3-8025-92bec850c1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047425ac-9b3a-4fb3-8025-92bec850c1ad', 'volume_size': 1} Nov 02 12:37:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:28 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc 1073741824" returned: 0 in 1.165s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:28 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:28 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:29 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:29 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:29 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1502955262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047425ac-9b3a-4fb3-8025-92bec850c1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ca25b908ff461a8c9a6c25a602a624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:27Z,use_quota=True,user_id='9fcca3e0cfe7496b81048625b719e80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Creating volume 047425ac-9b3a-4fb3-8025-92bec850c1ad {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:29 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:29 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad 1073741824 Nov 02 12:37:29 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863525f4-9049-44a8-8b62-40ce88937141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59ab3c9-263f-4201-8304-8fa81ac940fc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd1c2ed-daf0-41da-b343-2ca425d8b065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Volume volume-b59ab3c9-263f-4201-8304-8fa81ac940fc (b59ab3c9-263f-4201-8304-8fa81ac940fc): created successfully Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd1c2ed-daf0-41da-b343-2ca425d8b065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Flow 'volume_create_manager' (09d12952-7647-4605-9fe9-3406c96442d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fbb4251f-c7a2-4ab1-a8b1-6a08dc85c976 tempest-GroupsV314Test-117547828 None] Created volume successfully. Nov 02 12:37:29 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.832s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 8 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:37:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:37:30 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad 1073741824" returned: 0 in 1.219s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:30 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad Nov 02 12:37:30 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:30 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda7da10-9f68-4eed-a593-26d3f65e72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047425ac-9b3a-4fb3-8025-92bec850c1ad', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1e31cf-aaf3-48be-950b-7b45db3896dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Volume volume-047425ac-9b3a-4fb3-8025-92bec850c1ad (047425ac-9b3a-4fb3-8025-92bec850c1ad): created successfully Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1e31cf-aaf3-48be-950b-7b45db3896dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Flow 'volume_create_manager' (c46c9fd9-3526-49d9-8682-1978d30f453b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-988917c0-d702-41a0-8c01-3704fe50e90b tempest-VolumesTransfersV357Test-1391915219 None] Created volume successfully. Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "cinder-047425ac-9b3a-4fb3-8025-92bec850c1ad-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-047425ac-9b3a-4fb3-8025-92bec850c1ad-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Cloning volume b59ab3c9-263f-4201-8304-8fa81ac940fc to volume 49168873-bc6e-4ea2-9eb7-9fb71e87dda9 Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "cinder-quobyte-047425ac-9b3a-4fb3-8025-92bec850c1ad" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-quobyte-047425ac-9b3a-4fb3-8025-92bec850c1ad" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Creating offline snapshot ab30559f-c4c2-448d-99ac-b03b73492dc8 of volume b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e417ad-6139-48d8-a3de-6e110c6bdece]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3da096-023e-43d3-8690-80e38ee5b6bc]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:32 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad Nov 02 12:37:32 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:33 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:33 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:33 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad" returned: 0 in 0.656s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:33 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad Nov 02 12:37:33 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:33 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047425ac-9b3a-4fb3-8025-92bec850c1ad" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-quobyte-047425ac-9b3a-4fb3-8025-92bec850c1ad" released by "delete_volume" :: held 1.242s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Created reservations ['399a2194-a8a3-45f7-9759-1497b4245da9', '8381987e-687f-431c-9c0b-2cad081d6854', '85d89305-aac0-4b9c-8ae5-daebfa809e88', '9bc3cd6b-043c-4d38-96be-498d5e275293'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:34 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 1.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 1G Nov 02 12:37:34 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:34 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 1G" returned: 0 in 0.715s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59ab3c9-263f-4201-8304-8fa81ac940fc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59ab3c9-263f-4201-8304-8fa81ac940fc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:34 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.704s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:34 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Deleted volume successfully. Nov 02 12:37:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-87c2fcb4-617f-43ff-be1b-4379bdbcdcc0 tempest-VolumesTransfersV357Test-1778094723 None] Lock "cinder-047425ac-9b3a-4fb3-8025-92bec850c1ad-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:35 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b59ab3c9-263f-4201-8304-8fa81ac940fc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.796s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:35 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:37:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:35 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:35 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:36 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.689s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:36 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info Nov 02 12:37:36 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:36 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info" returned: 0 in 0.551s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:36 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:37:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:36 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info Nov 02 12:37:36 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:37 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.info" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Acquiring lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] snapshot: ab30559f-c4c2-448d-99ac-b03b73492dc8, volume: 49168873-bc6e-4ea2-9eb7-9fb71e87dda9, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac3886-ef56-49a7-a0ae-bfdc3c33c5d7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:37 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:37 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:38 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.867s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b59ab3c9-263f-4201-8304-8fa81ac940fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d2772-bfec-4eb3-b894-b6d704f51737]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:38 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:38 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:38 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:37:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:38 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 Nov 02 12:37:38 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=83,cinder:SELECT=55,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=63,cinder:INSERT=17,cinder:UPDATE=66,cinder:DELETE=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Flow 'volume_create_manager' (76a5f56b-c5a4-4e61-9900-cc5aaa32e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba68b4f-5013-4337-a2db-2707807e7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba68b4f-5013-4337-a2db-2707807e7c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928812192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df89c6d4-31d4-464a-a6d1-5306c7b4040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f626fce15c4dcc835b00140ea2b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:47Z,use_quota=True,user_id='15ec722a41344599b8c6e9e3d9dd9b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4c8dbf-9b88-4e3c-bfea-2c144a1d0340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4c8dbf-9b88-4e3c-bfea-2c144a1d0340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a780a5d9-cd76-4e7c-ba84-0bac3ea6b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a780a5d9-cd76-4e7c-ba84-0bac3ea6b557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df89c6d4-31d4-464a-a6d1-5306c7b4040c', 'volume_name': 'volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bbe88b-76b2-4234-81dd-11adcb894f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bbe88b-76b2-4234-81dd-11adcb894f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c62b6-bc57-45bc-a0f5-0177b6b3ad09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Volume df89c6d4-31d4-464a-a6d1-5306c7b4040c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c', 'volume_size': 1} Nov 02 12:37:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:48 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" returned: 0 in 9.850s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:48 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:37:48 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Converted 1024.00 MB image at 103.94 MB/s Nov 02 12:37:48 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:37:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 Nov 02 12:37:48 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:49 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" released by "_copy_volume_from_snapshot" :: held 11.720s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Acquiring lock "cinder-quobyte-ab30559f-c4c2-448d-99ac-b03b73492dc8" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-ab30559f-c4c2-448d-99ac-b03b73492dc8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Deleting offline snapshot ab30559f-c4c2-448d-99ac-b03b73492dc8 of volume b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] snapshot_file for this snap is: volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de78b21-d780-4877-9429-4437e3623015]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:49 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:49 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:49 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b59ab3c9-263f-4201-8304-8fa81ac940fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e6c576-8f47-4912-9808-c3462afb5799]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:49 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:49 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 0.574s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:50 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8 Nov 02 12:37:50 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc.ab30559f-c4c2-448d-99ac-b03b73492dc8" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-ab30559f-c4c2-448d-99ac-b03b73492dc8" released by "_delete_snapshot" :: held 1.850s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.623s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928812192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df89c6d4-31d4-464a-a6d1-5306c7b4040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f626fce15c4dcc835b00140ea2b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:47Z,use_quota=True,user_id='15ec722a41344599b8c6e9e3d9dd9b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Creating volume df89c6d4-31d4-464a-a6d1-5306c7b4040c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:51 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c 1073741824 Nov 02 12:37:51 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3f0f4470-4eae-4de6-a6c9-c6e5b26d0d14 tempest-GroupsV314Test-117547828 None] Create group from source-group-8cbf43d7-4cc5-4e6b-8575-ab8847e77084 completed successfully. Nov 02 12:37:51 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c 1073741824" returned: 0 in 0.506s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:51 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c Nov 02 12:37:51 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8c62b6-bc57-45bc-a0f5-0177b6b3ad09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb5314f-a7aa-4369-be80-21576bfc61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Volume volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c (df89c6d4-31d4-464a-a6d1-5306c7b4040c): created successfully Nov 02 12:37:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb5314f-a7aa-4369-be80-21576bfc61b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Flow 'volume_create_manager' (76a5f56b-c5a4-4e61-9900-cc5aaa32e043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c758ad93-0abb-4651-830f-1fb796a96b74 tempest-ServersNegativeTestJSON-2052014615 None] Created volume successfully. Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Acquiring lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0044482-07f7-4877-b4c4-bcfa5b3f0c01]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:52 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 Nov 02 12:37:52 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:52 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:52 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9 Nov 02 12:37:52 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:52 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-49168873-bc6e-4ea2-9eb7-9fb71e87dda9" released by "delete_volume" :: held 0.765s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Created reservations ['05193216-aa96-4c91-84d5-e8dbffcf5e2a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:53 devstack cinder-volume[86731]: WARNING cinder.quota [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-439822469 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-439822469, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:37:53 devstack cinder-volume[86731]: WARNING cinder.quota [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-439822469 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-439822469, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Created reservations ['f5f14896-a25d-4d61-995e-716834fb5036', '4ddcf6dd-84eb-40be-aaee-f9416450d121', '929ba735-af9f-4fd9-ae4f-a6d088347330', '8e38bed7-447c-4a8a-8fee-f74f702c1152'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:53 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:53 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:53 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d1dde4ab-4e6e-4573-b752-8e2f93cae1d6 tempest-GroupsV314Test-117547828 None] Delete group completed successfully. Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Acquiring lock "cinder-quobyte-b59ab3c9-263f-4201-8304-8fa81ac940fc" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-b59ab3c9-263f-4201-8304-8fa81ac940fc" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7103ac-cef1-47a0-b0f8-2af3bdb81c67]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:54 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:54 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:54 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 0.502s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:54 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc Nov 02 12:37:54 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:54 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b59ab3c9-263f-4201-8304-8fa81ac940fc" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Lock "cinder-quobyte-b59ab3c9-263f-4201-8304-8fa81ac940fc" released by "delete_volume" :: held 1.004s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Created reservations ['41694ab1-9d71-4899-9b48-39f629986a33'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Created reservations ['958ed48f-1996-4c0a-b705-f6d707d4ead3', 'c93fe58c-085b-4ddc-a43c-814cef72eb7c', '42810a77-cc88-44d6-af74-6aaa70433048', 'dd5df501-3dfd-44bd-a435-09103298c0a5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Flow 'volume_create_manager' (554b8a16-1f18-4fba-8a4a-5abef4d0540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d907407-948c-4002-a9bd-204763d702d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d907407-948c-4002-a9bd-204763d702d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-615293945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de513b0-6143-4611-9ea9-7826234f24a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf25390e7f60489aa44cbdd205ddf1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:55Z,use_quota=True,user_id='73d61da699e54b25af7c45ff82938faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fa7b89-2049-4f68-a5b7-1b17960a1c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fa7b89-2049-4f68-a5b7-1b17960a1c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ac858d-7214-4cf9-b713-57d8c2380485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ac858d-7214-4cf9-b713-57d8c2380485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de513b0-6143-4611-9ea9-7826234f24a0', 'volume_name': 'volume-5de513b0-6143-4611-9ea9-7826234f24a0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0f268-ec78-4627-9427-add3a7d13ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b0f268-ec78-4627-9427-add3a7d13ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5180e36c-e5ab-4087-82c9-b78ee7b34ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Volume 5de513b0-6143-4611-9ea9-7826234f24a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de513b0-6143-4611-9ea9-7826234f24a0', 'volume_size': 1} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-615293945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de513b0-6143-4611-9ea9-7826234f24a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf25390e7f60489aa44cbdd205ddf1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:55Z,use_quota=True,user_id='73d61da699e54b25af7c45ff82938faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Creating volume 5de513b0-6143-4611-9ea9-7826234f24a0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:55 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 1073741824 Nov 02 12:37:55 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:55 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:37:55 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:37:56 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Flow 'volume_create_manager' (85644ef9-b4fc-44dd-b443-0984e855bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97039014-8871-4883-8dbe-b4ffd48e977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7639ba72-2f54-4f09-a1d9-444e869eb981 tempest-GroupsV314Test-117547828 None] Delete group completed successfully. Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97039014-8871-4883-8dbe-b4ffd48e977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1588580815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3539b66-2ff8-46d8-aa18-31fba90dc594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f626fce15c4dcc835b00140ea2b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:56Z,use_quota=True,user_id='15ec722a41344599b8c6e9e3d9dd9b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a1b45c-c812-4baa-8a64-3baa54a1284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a1b45c-c812-4baa-8a64-3baa54a1284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69df6c0-e920-49d5-a0ed-1ea7c9deab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69df6c0-e920-49d5-a0ed-1ea7c9deab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3539b66-2ff8-46d8-aa18-31fba90dc594', 'volume_name': 'volume-c3539b66-2ff8-46d8-aa18-31fba90dc594', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e72028-19ce-41d5-aabc-b43d60bede8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e72028-19ce-41d5-aabc-b43d60bede8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc0bfe3-62a6-4923-ae16-48d1d9c33ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Volume c3539b66-2ff8-46d8-aa18-31fba90dc594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3539b66-2ff8-46d8-aa18-31fba90dc594', 'volume_size': 1} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 1073741824" returned: 0 in 0.771s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:56 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 Nov 02 12:37:56 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:56 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1588580815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3539b66-2ff8-46d8-aa18-31fba90dc594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f626fce15c4dcc835b00140ea2b015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:56Z,use_quota=True,user_id='15ec722a41344599b8c6e9e3d9dd9b2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Creating volume c3539b66-2ff8-46d8-aa18-31fba90dc594 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:56 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5180e36c-e5ab-4087-82c9-b78ee7b34ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de513b0-6143-4611-9ea9-7826234f24a0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 1073741824 Nov 02 12:37:56 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd24f97-2db0-464d-85db-ad1afc2ce550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Volume volume-5de513b0-6143-4611-9ea9-7826234f24a0 (5de513b0-6143-4611-9ea9-7826234f24a0): created successfully Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd24f97-2db0-464d-85db-ad1afc2ce550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Flow 'volume_create_manager' (554b8a16-1f18-4fba-8a4a-5abef4d0540c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aabeda68-e2aa-4156-b148-93318d550ec9 tempest-ServerActionsTestOtherA-646512174 None] Created volume successfully. Nov 02 12:37:57 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 1073741824" returned: 0 in 0.734s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:57 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 Nov 02 12:37:57 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:57 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594" returned: 0 in 0.369s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc0bfe3-62a6-4923-ae16-48d1d9c33ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3539b66-2ff8-46d8-aa18-31fba90dc594', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc2b929-2a05-421e-bc6d-ae01dea21350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Volume volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 (c3539b66-2ff8-46d8-aa18-31fba90dc594): created successfully Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc2b929-2a05-421e-bc6d-ae01dea21350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Flow 'volume_create_manager' (85644ef9-b4fc-44dd-b443-0984e855bc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4e85e0b2-5772-4c74-aad7-ab8c8776e3d4 tempest-ServersNegativeTestJSON-2052014615 None] Created volume successfully. Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "cinder-c3539b66-2ff8-46d8-aa18-31fba90dc594-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-c3539b66-2ff8-46d8-aa18-31fba90dc594-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "cinder-quobyte-c3539b66-2ff8-46d8-aa18-31fba90dc594" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-quobyte-c3539b66-2ff8-46d8-aa18-31fba90dc594" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ec0ab-9411-41e9-b47e-601b23646f39]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:00 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 Nov 02 12:38:00 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:00 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:00 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594 Nov 02 12:38:00 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Flow 'volume_create_manager' (75a9ed5c-3d51-4473-b77c-1aa4c5d9fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f69ddb8-a2d3-4fbe-8c11-3920bfb761ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f69ddb8-a2d3-4fbe-8c11-3920bfb761ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300403001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6e3551-514d-4bf2-9d01-2064a7518ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425f9e8dd50d4332be8bd9087adc91f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:00Z,use_quota=True,user_id='c400e4dda74342319f563023c27d69cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c635176-dec4-4592-b147-f8eaee0115ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c635176-dec4-4592-b147-f8eaee0115ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9f26a4-aae9-48a0-af48-3203f74003b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9f26a4-aae9-48a0-af48-3203f74003b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6e3551-514d-4bf2-9d01-2064a7518ed0', 'volume_name': 'volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afd5950-a7af-4d73-b9d1-2812ae942aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afd5950-a7af-4d73-b9d1-2812ae942aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f1615-6773-41f0-aa7f-051e9bc9b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Volume ad6e3551-514d-4bf2-9d01-2064a7518ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0', 'volume_size': 1} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300403001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6e3551-514d-4bf2-9d01-2064a7518ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425f9e8dd50d4332be8bd9087adc91f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:00Z,use_quota=True,user_id='c400e4dda74342319f563023c27d69cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Creating volume ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:00 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:00 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 1073741824 Nov 02 12:38:00 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:00 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c3539b66-2ff8-46d8-aa18-31fba90dc594" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-quobyte-c3539b66-2ff8-46d8-aa18-31fba90dc594" released by "delete_volume" :: held 0.958s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Created reservations ['f7c8cdb1-f791-42cb-b027-38df07ec95b5', 'fe38c542-2dd1-4061-b936-50335a7b0b96', 'c9c09c34-9c1c-42f2-8f47-823076823510', '48a54adc-8132-4532-84ce-37969e45f136'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:01 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:38:01 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:01 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 1073741824" returned: 0 in 0.618s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:01 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:38:01 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:01 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Deleted volume successfully. Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce732293-535b-44f3-aa44-151a1ee838ed tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-c3539b66-2ff8-46d8-aa18-31fba90dc594-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:01 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f1615-6773-41f0-aa7f-051e9bc9b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c722b4-1e11-4e8f-b70a-05632c2296ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Volume volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 (ad6e3551-514d-4bf2-9d01-2064a7518ed0): created successfully Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c722b4-1e11-4e8f-b70a-05632c2296ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Flow 'volume_create_manager' (75a9ed5c-3d51-4473-b77c-1aa4c5d9fc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dd194911-567b-418f-bc55-a65050b15ed7 tempest-VolumesActionsTest-78690998 None] Created volume successfully. Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "cinder-df89c6d4-31d4-464a-a6d1-5306c7b4040c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-df89c6d4-31d4-464a-a6d1-5306c7b4040c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "cinder-quobyte-df89c6d4-31d4-464a-a6d1-5306c7b4040c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-quobyte-df89c6d4-31d4-464a-a6d1-5306c7b4040c" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae29df7-1523-45e6-acee-626cc976516c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:02 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c Nov 02 12:38:02 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:02 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:02 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c Nov 02 12:38:02 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:03 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-df89c6d4-31d4-464a-a6d1-5306c7b4040c" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-quobyte-df89c6d4-31d4-464a-a6d1-5306c7b4040c" released by "delete_volume" :: held 1.028s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Created reservations ['42075576-c53d-48d7-b198-cbe0c777a1ef', 'd1e761ec-d18d-409f-8b6b-13b83cfaed9a', 'ae390b68-4296-45d7-b797-2bef02abe210', 'e037c952-4f59-4d66-a056-44363907a9e2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:03 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:38:03 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:03 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Deleted volume successfully. Nov 02 12:38:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-779ed969-01d7-4208-9b66-2a47087ef3de tempest-ServersNegativeTestJSON-2052014615 None] Lock "cinder-df89c6d4-31d4-464a-a6d1-5306c7b4040c-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Flow 'volume_create_manager' (9cf954f9-2a4c-4acd-b434-e3c59ccb1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84da5a1-d2ae-4809-b02d-e4f8d7bd94eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84da5a1-d2ae-4809-b02d-e4f8d7bd94eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1672698776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f875181-3b08-482d-beda-131d87db9f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c2b8bcb8a445aba043f2846c943ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:06Z,use_quota=True,user_id='25849a8f89934b1fa525755e23edc445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8237f967-51a7-4216-bb11-b8ed23180a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8237f967-51a7-4216-bb11-b8ed23180a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc0e02-2139-4a7b-883f-74dccf3020b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dc0e02-2139-4a7b-883f-74dccf3020b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f875181-3b08-482d-beda-131d87db9f90', 'volume_name': 'volume-0f875181-3b08-482d-beda-131d87db9f90', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b428aca-7865-4812-af90-c503fb454613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b428aca-7865-4812-af90-c503fb454613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad27bf30-4673-4137-aad6-c09d95259cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Volume 0f875181-3b08-482d-beda-131d87db9f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f875181-3b08-482d-beda-131d87db9f90', 'volume_size': 1} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1672698776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f875181-3b08-482d-beda-131d87db9f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c2b8bcb8a445aba043f2846c943ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:06Z,use_quota=True,user_id='25849a8f89934b1fa525755e23edc445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Creating volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:06 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:38:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:06 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 1073741824 Nov 02 12:38:06 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:07 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 1073741824" returned: 0 in 0.664s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:07 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 Nov 02 12:38:07 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:07 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90" returned: 0 in 0.595s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad27bf30-4673-4137-aad6-c09d95259cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f875181-3b08-482d-beda-131d87db9f90', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebb0e24-1c3e-4039-a945-44d8b5a7eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Volume volume-0f875181-3b08-482d-beda-131d87db9f90 (0f875181-3b08-482d-beda-131d87db9f90): created successfully Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebb0e24-1c3e-4039-a945-44d8b5a7eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Flow 'volume_create_manager' (9cf954f9-2a4c-4acd-b434-e3c59ccb1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cbde5002-4586-4e7b-958c-1b87d911aaa2 tempest-SnapshotsActionsTest-1986745745 None] Created volume successfully. Nov 02 12:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Creating offline snapshot b9b1abb0-8f4d-49da-9b6d-d8217f7824de of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:38:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7970b2db-fcb7-4329-b72d-1e7a5412a5f1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:08 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 Nov 02 12:38:08 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:09 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90" returned: 0 in 0.597s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:09 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de 1G Nov 02 12:38:09 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de 1G" returned: 0 in 0.769s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:10 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:10 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de is being set with open permissions: ugo+rw Nov 02 12:38:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:10 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:11 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info Nov 02 12:38:11 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:11 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info" returned: 0 in 0.672s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info is being set with open permissions: ugo+rw Nov 02 12:38:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:11 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info Nov 02 12:38:11 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:12 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.info" returned: 0 in 0.629s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd4739f7-0f8c-48b0-aadc-63157d3ae33a tempest-SnapshotsActionsTest-1986745745 None] Create snapshot completed successfully Nov 02 12:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Creating offline snapshot d38b13ce-ce9b-45a3-adf6-a739804f43b9 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:38:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[54807578-6742-48e5-a4d4-32bba9994117]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:14 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:14 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:15 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.804s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:15 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 1G Nov 02 12:38:15 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:15 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 1G" returned: 0 in 0.725s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:16 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 Nov 02 12:38:16 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:16 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:16 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 is being set with open permissions: ugo+rw Nov 02 12:38:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:16 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 Nov 02 12:38:16 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fa9a532b-9331-4944-81d1-5ea1d4d67b9a tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fa9a532b-9331-4944-81d1-5ea1d4d67b9a tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" acquired by "attach_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:17 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9" returned: 0 in 0.581s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fa9a532b-9331-4944-81d1-5ea1d4d67b9a tempest-VolumesActionsTest-78690998 None] Attaching volume ad6e3551-514d-4bf2-9d01-2064a7518ed0 to instance 907814ca-40fb-4a9d-917d-e49518fab0d6 at mountpoint /dev/vdb on host None. Nov 02 12:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9e0a9566-c7fa-4955-8f97-192c88596b52 tempest-SnapshotsActionsTest-1986745745 None] Create snapshot completed successfully Nov 02 12:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fa9a532b-9331-4944-81d1-5ea1d4d67b9a tempest-VolumesActionsTest-78690998 None] Attach volume completed successfully. Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fa9a532b-9331-4944-81d1-5ea1d4d67b9a tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" released by "attach_volume" :: held 0.286s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c35446ef-d81d-4e98-8ebf-7cf66f7f9c42 tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c35446ef-d81d-4e98-8ebf-7cf66f7f9c42 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c35446ef-d81d-4e98-8ebf-7cf66f7f9c42 tempest-VolumesActionsTest-78690998 None] Detaching volume ad6e3551-514d-4bf2-9d01-2064a7518ed0 from instance 907814ca-40fb-4a9d-917d-e49518fab0d6. Nov 02 12:38:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c35446ef-d81d-4e98-8ebf-7cf66f7f9c42 tempest-VolumesActionsTest-78690998 None] Detach volume completed successfully. Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c35446ef-d81d-4e98-8ebf-7cf66f7f9c42 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-d38b13ce-ce9b-45a3-adf6-a739804f43b9-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-d38b13ce-ce9b-45a3-adf6-a739804f43b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-d38b13ce-ce9b-45a3-adf6-a739804f43b9" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-d38b13ce-ce9b-45a3-adf6-a739804f43b9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Deleting offline snapshot d38b13ce-ce9b-45a3-adf6-a739804f43b9 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:38:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] snapshot_file for this snap is: volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b533985-7111-47cd-b4e2-1a082fd54d1d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:18 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 Nov 02 12:38:18 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:18 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9" returned: 0 in 0.811s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8f4f7-5813-404e-9bc5-1fcb5432596a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:19 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:19 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.775s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 Nov 02 12:38:19 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:20 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9" returned: 0 in 0.697s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:20 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9 Nov 02 12:38:20 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:20 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.d38b13ce-ce9b-45a3-adf6-a739804f43b9" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-d38b13ce-ce9b-45a3-adf6-a739804f43b9" released by "_delete_snapshot" :: held 2.967s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_snapshot" :: held 3.018s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Created reservations ['8a95ce4e-fda6-42f0-8509-b60b7a93581f', 'e78f3e4c-e5e4-4960-9fcf-bfaeca74ce3c', 'c58d1378-08d1-46b2-b620-592293e34f5f', '2e377b26-767d-4098-b2df-0d536ab29b36'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Delete snapshot completed successfully. Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8d5befea-4612-404e-9778-2370e80e5e7b tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-d38b13ce-ce9b-45a3-adf6-a739804f43b9-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Creating offline snapshot 3d98668a-6c36-41e2-a182-3238649ff984 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e9ee41-37b0-4b56-ab04-af36fceb0bed]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:21 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:21 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:22 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:22 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 1G Nov 02 12:38:22 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:23 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 1G" returned: 0 in 0.810s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:23 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 Nov 02 12:38:23 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:23 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:23 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 is being set with open permissions: ugo+rw Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:23 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 Nov 02 12:38:23 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:23 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd90e8e9-876a-4015-9fa7-a499b4a93a3e tempest-SnapshotsActionsTest-1986745745 None] Create snapshot completed successfully Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-3d98668a-6c36-41e2-a182-3238649ff984-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-3d98668a-6c36-41e2-a182-3238649ff984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-3d98668a-6c36-41e2-a182-3238649ff984" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-3d98668a-6c36-41e2-a182-3238649ff984" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Deleting offline snapshot 3d98668a-6c36-41e2-a182-3238649ff984 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] snapshot_file for this snap is: volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ecc4b-1006-45d1-b1b5-e251e6929dc2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:25 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 Nov 02 12:38:25 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:25 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[31098e65-6a44-4fa5-a68b-5faa8488ff7a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:25 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:25 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:26 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:26 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 Nov 02 12:38:26 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:26 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:26 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984 Nov 02 12:38:26 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:27 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.3d98668a-6c36-41e2-a182-3238649ff984" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-3d98668a-6c36-41e2-a182-3238649ff984" released by "_delete_snapshot" :: held 2.020s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_snapshot" :: held 2.058s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:27 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Created reservations ['372d26d2-97aa-4c82-bfd5-fdaf899f22d5', 'd3355dce-3987-4506-a6c0-032b6abb804f', '9a015145-1cd0-4325-acb1-0e884b8c061a', '4d0f9869-9c6d-446b-81c2-67608fbd85a4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Delete snapshot completed successfully. Nov 02 12:38:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a6059a0d-9787-4662-84d7-fb969396e1af tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-3d98668a-6c36-41e2-a182-3238649ff984-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Creating offline snapshot 59ee436a-7a8b-44a0-b86b-78256458a569 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa4739-ff51-4bc9-8126-c516624f6db5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:28 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:38:28 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:28 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:28 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:29 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.316s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 8 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:38:29 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.484s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:29 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 1G Nov 02 12:38:29 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:29 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 1G" returned: 0 in 0.668s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:30 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 Nov 02 12:38:30 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:30 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569" returned: 0 in 0.483s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:30 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 is being set with open permissions: ugo+rw Nov 02 12:38:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:30 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 Nov 02 12:38:30 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:30 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569" returned: 0 in 0.526s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-25acb379-7c92-4099-84cd-631b0a513ed8 tempest-SnapshotsActionsTest-1986745745 None] Create snapshot completed successfully Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-59ee436a-7a8b-44a0-b86b-78256458a569-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-59ee436a-7a8b-44a0-b86b-78256458a569-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-59ee436a-7a8b-44a0-b86b-78256458a569" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-59ee436a-7a8b-44a0-b86b-78256458a569" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Deleting offline snapshot 59ee436a-7a8b-44a0-b86b-78256458a569 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] snapshot_file for this snap is: volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0f07f-748d-4c71-bd76-cb4295f23883]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:32 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 Nov 02 12:38:32 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:33 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569" returned: 0 in 0.711s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[774774f5-b196-4fe3-a6db-8c04e4f8a9c9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:33 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:33 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:33 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.758s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:33 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 Nov 02 12:38:33 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7d09e030-a8a0-4334-885e-fc80da35a475 tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7d09e030-a8a0-4334-885e-fc80da35a475 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" acquired by "attach_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7d09e030-a8a0-4334-885e-fc80da35a475 tempest-VolumesActionsTest-78690998 None] Attaching volume ad6e3551-514d-4bf2-9d01-2064a7518ed0 to instance 23ec3a85-d409-433b-b460-a788f3d549a7 at mountpoint /dev/vdb on host None. Nov 02 12:38:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7d09e030-a8a0-4334-885e-fc80da35a475 tempest-VolumesActionsTest-78690998 None] Attach volume completed successfully. Nov 02 12:38:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7d09e030-a8a0-4334-885e-fc80da35a475 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0" released by "attach_volume" :: held 0.184s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:34 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569" returned: 0 in 0.776s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:34 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569 Nov 02 12:38:34 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a1b0f198-84f5-4fa3-9d27-5b41c223b646 tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a1b0f198-84f5-4fa3-9d27-5b41c223b646 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a1b0f198-84f5-4fa3-9d27-5b41c223b646 tempest-VolumesActionsTest-78690998 None] Detaching volume ad6e3551-514d-4bf2-9d01-2064a7518ed0 from instance 23ec3a85-d409-433b-b460-a788f3d549a7. Nov 02 12:38:35 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.59ee436a-7a8b-44a0-b86b-78256458a569" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-59ee436a-7a8b-44a0-b86b-78256458a569" released by "_delete_snapshot" :: held 2.986s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_snapshot" :: held 3.039s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a1b0f198-84f5-4fa3-9d27-5b41c223b646 tempest-VolumesActionsTest-78690998 None] Detach volume completed successfully. Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a1b0f198-84f5-4fa3-9d27-5b41c223b646 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Created reservations ['ca85e5dc-9111-4a15-992e-f7465cd61403', '2c5dfcff-02a3-4b10-bcf8-5e7e24c9482b', '60a72c4a-de36-445c-b99b-e17d157ca170', '0a9a3115-4568-47ad-96b1-366971b1f6f8'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Delete snapshot completed successfully. Nov 02 12:38:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bb6510d5-2b48-4e28-bce1-2a0441385840 tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-59ee436a-7a8b-44a0-b86b-78256458a569-delete_snapshot" released by "delete_snapshot" :: held 3.353s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Creating offline snapshot 129227a9-01b5-41de-9608-0814269fab25 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b5fc8-a678-457e-96f0-627a0e55013f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:37 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:37 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:37 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:37 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 1G Nov 02 12:38:37 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:38 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 1G" returned: 0 in 0.768s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:38 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 Nov 02 12:38:38 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5c389597-42ed-4406-9dd9-89355448e67d req-84dbf92a-c898-4848-9984-185c97f93421 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:38 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25" returned: 0 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:38 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 is being set with open permissions: ugo+rw Nov 02 12:38:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:38 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 Nov 02 12:38:38 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:39 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5c389597-42ed-4406-9dd9-89355448e67d req-84dbf92a-c898-4848-9984-185c97f93421 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.463s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5c389597-42ed-4406-9dd9-89355448e67d req-84dbf92a-c898-4848-9984-185c97f93421 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1a7d3a33-a696-4827-a668-d2ddfdaf9c68 tempest-SnapshotsActionsTest-1986745745 None] Create snapshot completed successfully Nov 02 12:38:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-5c389597-42ed-4406-9dd9-89355448e67d req-84dbf92a-c898-4848-9984-185c97f93421 tempest-ServerActionsTestOtherA-646512174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-5de513b0-6143-4611-9ea9-7826234f24a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70b6b392-d80d-4951-a49b-f2d1008787c8', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:38:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-5c389597-42ed-4406-9dd9-89355448e67d req-84dbf92a-c898-4848-9984-185c97f93421 tempest-ServerActionsTestOtherA-646512174 None] attachment_update completed successfully. Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-129227a9-01b5-41de-9608-0814269fab25-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-129227a9-01b5-41de-9608-0814269fab25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Acquiring lock "cinder-quobyte-129227a9-01b5-41de-9608-0814269fab25" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-129227a9-01b5-41de-9608-0814269fab25" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Deleting offline snapshot 129227a9-01b5-41de-9608-0814269fab25 of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] snapshot_file for this snap is: volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09a83b3-09db-4da8-97ca-8c9b15d13646]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:40 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 Nov 02 12:38:40 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:41 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25" returned: 0 in 0.626s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aa89d6-301a-4ef1-be6e-1c5829d48f8b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:41 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:41 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:41 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.542s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b5e35-ab84-42e8-90a7-35fde228da45]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:41 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 Nov 02 12:38:41 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:42 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:38:42 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:42 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5cebc6-8f35-4bc6-a74e-e09f83d55fc4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:42 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25" returned: 0 in 0.671s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:42 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25 Nov 02 12:38:42 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:42 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:38:42 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:42 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.129227a9-01b5-41de-9608-0814269fab25" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-129227a9-01b5-41de-9608-0814269fab25" released by "_delete_snapshot" :: held 2.374s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_snapshot" :: held 2.422s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:43 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.571s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.716c0d0b-53e3-4dd4-bd20-664135382b3024d7sesf.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:43 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.716c0d0b-53e3-4dd4-bd20-664135382b3024d7sesf.img Nov 02 12:38:43 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Created reservations ['95049d5d-8b68-4f3c-81e7-f6774948c66e', 'c2382411-e014-4802-a651-e4c99e3e720c', '5b02bd26-2406-4ddf-a712-568b973bfeef', 'f7497419-8c8f-4cf3-8183-b65aec9e23c3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Delete snapshot completed successfully. Nov 02 12:38:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b9f5d08e-b8ed-4a2c-b948-c87944f40b7a tempest-SnapshotsActionsTest-1402770503 None] Lock "cinder-129227a9-01b5-41de-9608-0814269fab25-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-9e4c1ad7-b4f0-4abb-b8d6-c54b6b3bedf0 tempest-ServerActionsTestOtherA-646512174 None] Terminate volume connection completed successfully. Nov 02 12:38:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-9e4c1ad7-b4f0-4abb-b8d6-c54b6b3bedf0 tempest-ServerActionsTestOtherA-646512174 None] Deleting attachment 70b6b392-d80d-4951-a49b-f2d1008787c8. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "cinder-b9b1abb0-8f4d-49da-9b6d-d8217f7824de-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-b9b1abb0-8f4d-49da-9b6d-d8217f7824de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "cinder-quobyte-b9b1abb0-8f4d-49da-9b6d-d8217f7824de" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-30993b30-5612-4233-ac5a-afe160583303 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-b9b1abb0-8f4d-49da-9b6d-d8217f7824de" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Deleting offline snapshot b9b1abb0-8f4d-49da-9b6d-d8217f7824de of volume 0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] snapshot_file for this snap is: volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c51d13-7712-4352-9397-c1f1d9726d5a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:45 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:45 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:46 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 1.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f875181-3b08-482d-beda-131d87db9f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:38:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c008c9e2-caf4-48cd-9f66-87d69349cec7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:47 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 Nov 02 12:38:47 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:48 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90" returned: 0 in 1.126s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:48 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:48 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:49 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.880s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:49 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de Nov 02 12:38:49 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:49 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90.b9b1abb0-8f4d-49da-9b6d-d8217f7824de" returned: 0 in 0.632s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=87,cinder:SELECT=97,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=89,cinder:UPDATE=95,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-b9b1abb0-8f4d-49da-9b6d-d8217f7824de" released by "_delete_snapshot" :: held 4.518s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_snapshot" :: held 4.604s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:50 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Created reservations ['fd6aee7c-921e-4b70-adee-393eb3a7c4b3', '5fcfaca7-9468-4aef-af16-f1f7ec6644ed', '086b5464-c8dc-49ff-bdaf-22685a04fa4e', '9d540a0a-71dc-4234-98a9-1f03157910fd'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Delete snapshot completed successfully. Nov 02 12:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3dc8c626-23c9-4bcd-89c6-cd3659681248 tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-b9b1abb0-8f4d-49da-9b6d-d8217f7824de-delete_snapshot" released by "delete_snapshot" :: held 5.107s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "cinder-0f875181-3b08-482d-beda-131d87db9f90-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-0f875181-3b08-482d-beda-131d87db9f90-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" acquired by "delete_volume" :: waited 0.050s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c2469-0a01-43c4-a705-3e362fae0e5d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:51 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 Nov 02 12:38:51 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:52 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90" returned: 0 in 1.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:52 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90 Nov 02 12:38:52 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:53 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f875181-3b08-482d-beda-131d87db9f90" returned: 0 in 0.742s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-quobyte-0f875181-3b08-482d-beda-131d87db9f90" released by "delete_volume" :: held 2.243s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Created reservations ['3e536a8f-47f7-4cd7-9c1a-e428258b0cb3', '8c721dba-0d66-4beb-89c2-6b47c0d95b61', 'ac1aefc9-fd85-4b60-bfd0-7768e98121f1', 'f2b60441-3689-4f8d-8a15-a4cc13193cab'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:53 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:38:53 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:53 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.716c0d0b-53e3-4dd4-bd20-664135382b3024d7sesf.img" returned: 0 in 10.979s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dec24b-a511-45d7-88d2-cdb83e657f32]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:54 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:38:54 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:54 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Deleted volume successfully. Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bdcc4a25-bdf6-49a9-92c4-4bb7c5392f4a tempest-SnapshotsActionsTest-1986745745 None] Lock "cinder-0f875181-3b08-482d-beda-131d87db9f90-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:54 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.818s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0, size 1024.00 MB, duration 10.98 sec, destination /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.716c0d0b-53e3-4dd4-bd20-664135382b3024d7sesf.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:38:54 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Converted 1024.00 MB image at 93.26 MB/s Nov 02 12:38:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] 716c0d0b-53e3-4dd4-bd20-664135382b30 was raw, no need to convert to raw {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1192}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Flow 'volume_create_manager' (3b64e9b7-f647-4ea9-b032-16319b418f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8041845-4d5b-4d62-9ad7-786a2ad0c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8041845-4d5b-4d62-9ad7-786a2ad0c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1364819301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70814a2-5ab4-48b4-90ee-4f3c977c6292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c17a830b0ce4812a6576e7096d00131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:04Z,use_quota=True,user_id='d3d62c9bf62f44c9b62eb0d86e8a55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f42779-d5b8-4559-a03c-93dc3f5e2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f42779-d5b8-4559-a03c-93dc3f5e2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b009e684-97f3-4264-b8d3-c47f88926cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b009e684-97f3-4264-b8d3-c47f88926cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70814a2-5ab4-48b4-90ee-4f3c977c6292', 'volume_name': 'volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d815b9b0-f12e-4774-9600-17a83a3c7f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d815b9b0-f12e-4774-9600-17a83a3c7f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff6e942-2056-481a-904c-c63db2729ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume e70814a2-5ab4-48b4-90ee-4f3c977c6292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292', 'volume_size': 1} Nov 02 12:39:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:13 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:13 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (846e5f3d-c14b-4c59-a172-9c8721392f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806a380c-31cc-44df-89dd-0a99aa2dc598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806a380c-31cc-44df-89dd-0a99aa2dc598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-817724033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b862ebd6-1ff7-4630-a51b-9222f981e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:15Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf971a1-cfa6-4d08-854e-9ce70f4d878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf971a1-cfa6-4d08-854e-9ce70f4d878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa408d2-3eef-4f62-a808-f671fe62905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa408d2-3eef-4f62-a808-f671fe62905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b862ebd6-1ff7-4630-a51b-9222f981e515', 'volume_name': 'volume-b862ebd6-1ff7-4630-a51b-9222f981e515', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee66346-fa43-4961-bda1-c00612617bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee66346-fa43-4961-bda1-c00612617bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2e9d54-5b04-4c92-8436-eba6efa38800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Volume b862ebd6-1ff7-4630-a51b-9222f981e515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b862ebd6-1ff7-4630-a51b-9222f981e515', 'volume_size': 1} Nov 02 12:39:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.810s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Uploaded volume to glance image-id: 716c0d0b-53e3-4dd4-bd20-664135382b30. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-30993b30-5612-4233-ac5a-afe160583303 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 31.320s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-30993b30-5612-4233-ac5a-afe160583303 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.719s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1364819301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70814a2-5ab4-48b4-90ee-4f3c977c6292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c17a830b0ce4812a6576e7096d00131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:04Z,use_quota=True,user_id='d3d62c9bf62f44c9b62eb0d86e8a55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Creating volume e70814a2-5ab4-48b4-90ee-4f3c977c6292 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b52b6d09-7b5a-43b0-8ff3-534c7158f859 tempest-VolumesActionsTest-78690998 None] Copy volume to image completed successfully. Nov 02 12:39:16 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 1073741824 Nov 02 12:39:16 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-30993b30-5612-4233-ac5a-afe160583303 tempest-ServerActionsTestOtherA-646512174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-5de513b0-6143-4611-9ea9-7826234f24a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8cf8998-fb6f-4866-8db4-d828544f0b36', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:39:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-16dbf22e-e902-47a0-9ed3-f0673bb7180f req-30993b30-5612-4233-ac5a-afe160583303 tempest-ServerActionsTestOtherA-646512174 None] attachment_update completed successfully. Nov 02 12:39:17 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 1073741824" returned: 0 in 0.571s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:17 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 Nov 02 12:39:17 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:17 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.614s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-817724033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b862ebd6-1ff7-4630-a51b-9222f981e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:15Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Creating volume b862ebd6-1ff7-4630-a51b-9222f981e515 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:17 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:17 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 1073741824 Nov 02 12:39:17 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff6e942-2056-481a-904c-c63db2729ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949b736f-85af-4aa9-a11a-a5af0127c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 (e70814a2-5ab4-48b4-90ee-4f3c977c6292): created successfully Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949b736f-85af-4aa9-a11a-a5af0127c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Flow 'volume_create_manager' (3b64e9b7-f647-4ea9-b032-16319b418f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c55aa4f5-d8bd-416c-bf4d-bce62aaa1a41 tempest-VolumeQuotasAdminTestJSON-669622523 None] Created volume successfully. Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "cinder-e70814a2-5ab4-48b4-90ee-4f3c977c6292-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "cinder-e70814a2-5ab4-48b4-90ee-4f3c977c6292-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:18 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 1073741824" returned: 0 in 0.778s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "cinder-quobyte-e70814a2-5ab4-48b4-90ee-4f3c977c6292" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "cinder-quobyte-e70814a2-5ab4-48b4-90ee-4f3c977c6292" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64796da-cb91-40d4-8243-5abb5db2c836]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:18 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 Nov 02 12:39:18 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:18 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 Nov 02 12:39:18 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:18 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.309s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2e9d54-5b04-4c92-8436-eba6efa38800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b862ebd6-1ff7-4630-a51b-9222f981e515', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e0f72e-9ded-47b2-81ec-c1ca484bf454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37b853-6814-443f-b2c2-5c59a41ea057]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Volume volume-b862ebd6-1ff7-4630-a51b-9222f981e515 (b862ebd6-1ff7-4630-a51b-9222f981e515): created successfully Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e0f72e-9ded-47b2-81ec-c1ca484bf454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (846e5f3d-c14b-4c59-a172-9c8721392f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-81d9c7c3-9718-4014-a611-628fb5b6c03d tempest-AttachVolumeTestJSON-1043400045 None] Created volume successfully. Nov 02 12:39:19 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:39:19 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:19 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292" returned: 0 in 0.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack sudo[92316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292 Nov 02 12:39:19 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:19 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[620aece0-226d-45fb-861d-812c67eee53c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:19 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e70814a2-5ab4-48b4-90ee-4f3c977c6292" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "cinder-quobyte-e70814a2-5ab4-48b4-90ee-4f3c977c6292" released by "delete_volume" :: held 1.130s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Created reservations ['d06fcbaa-4257-4943-8f74-a5a79caaf7b1', '557de904-bbea-484d-910a-286b3fd6ba71', '02c1a1f5-d6db-4eae-9bbd-9909b15fc41c', 'f7ff6dfc-5946-427a-8097-39940f60eac3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:19 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:39:19 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:19 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.531s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:20 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img Nov 02 12:39:20 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Deleted volume successfully. Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36cccb27-3e80-42c1-b385-cc2ca5b94f28 tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "cinder-e70814a2-5ab4-48b4-90ee-4f3c977c6292-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bd0ebace-b9b0-4b96-8810-41a44d50cc74 req-b55bbe17-9137-4440-9cf2-e7618d9d295e tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Flow 'volume_create_manager' (41ba1c13-d508-467a-9118-3c1be6f4135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d46fea-18f5-442b-9f35-071b57788ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d46fea-18f5-442b-9f35-071b57788ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117870772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f9b256-75a6-4b71-bf03-070f5c566768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c17a830b0ce4812a6576e7096d00131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:22Z,use_quota=True,user_id='d3d62c9bf62f44c9b62eb0d86e8a55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74850ae7-aeaa-49b1-8919-6be146a20c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74850ae7-aeaa-49b1-8919-6be146a20c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bc0cc3-079e-42fa-b43e-515f82140892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bc0cc3-079e-42fa-b43e-515f82140892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f9b256-75a6-4b71-bf03-070f5c566768', 'volume_name': 'volume-a1f9b256-75a6-4b71-bf03-070f5c566768', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7f4fe8-fb62-4bd8-afb8-ce9e7265e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7f4fe8-fb62-4bd8-afb8-ce9e7265e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b237f2-2859-4513-9355-e04ac364542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume a1f9b256-75a6-4b71-bf03-070f5c566768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f9b256-75a6-4b71-bf03-070f5c566768', 'volume_size': 1} Nov 02 12:39:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:27 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img" returned: 0 in 7.917s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d3ae30-2323-4096-8790-9e8abf66a6b3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:39:28 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:28 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.525s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:39:28 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Converted 1024.00 MB image at 129.32 MB/s Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] 5b1fb3a1-f6af-49c0-a9db-f56417521062 was raw, converting to qcow2 {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1209}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cddb337-9188-48bf-a245-03c712b25a9c]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img Nov 02 12:39:28 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:28 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:28 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:28 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img Nov 02 12:39:28 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:29 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:29 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img" returned: 1 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img /opt/stack/data/cinder/conversion/vol_upload_veg48pr6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:29 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img /opt/stack/data/cinder/conversion/vol_upload_veg48pr6 Nov 02 12:39:29 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:29 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img /opt/stack/data/cinder/conversion/vol_upload_veg48pr6" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Image conversion details: src /opt/stack/data/cinder/conversion/ad6e3551-514d-4bf2-9d01-2064a7518ed0.temp_image.5b1fb3a1-f6af-49c0-a9db-f56417521062nm6n4m7p.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_veg48pr6 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:39:29 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[19004c0d-e903-49af-a775-4fe78d105862]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_veg48pr6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:29 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_veg48pr6 Nov 02 12:39:29 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:29 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_veg48pr6" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.442s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Uploaded volume to glance image-id: 5b1fb3a1-f6af-49c0-a9db-f56417521062. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bd0ebace-b9b0-4b96-8810-41a44d50cc74 req-b55bbe17-9137-4440-9cf2-e7618d9d295e tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.099s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-bd0ebace-b9b0-4b96-8810-41a44d50cc74 req-b55bbe17-9137-4440-9cf2-e7618d9d295e tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.587s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2117870772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f9b256-75a6-4b71-bf03-070f5c566768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c17a830b0ce4812a6576e7096d00131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:22Z,use_quota=True,user_id='d3d62c9bf62f44c9b62eb0d86e8a55e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Creating volume a1f9b256-75a6-4b71-bf03-070f5c566768 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-35538e49-45f8-46e1-a688-92e4d7cd1185 tempest-VolumesActionsTest-78690998 None] Copy volume to image completed successfully. Nov 02 12:39:31 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 1073741824 Nov 02 12:39:31 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bd0ebace-b9b0-4b96-8810-41a44d50cc74 req-b55bbe17-9137-4440-9cf2-e7618d9d295e tempest-AttachVolumeTestJSON-1043400045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-b862ebd6-1ff7-4630-a51b-9222f981e515', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bbc46e5-8ccb-42a4-a0c3-09a3e31ed33e', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:39:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-bd0ebace-b9b0-4b96-8810-41a44d50cc74 req-b55bbe17-9137-4440-9cf2-e7618d9d295e tempest-AttachVolumeTestJSON-1043400045 None] attachment_update completed successfully. Nov 02 12:39:32 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 1073741824" returned: 0 in 0.645s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:32 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 Nov 02 12:39:32 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:32 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b237f2-2859-4513-9355-e04ac364542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f9b256-75a6-4b71-bf03-070f5c566768', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5b92f-4f32-4dfa-ad2f-e125a843c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Volume volume-a1f9b256-75a6-4b71-bf03-070f5c566768 (a1f9b256-75a6-4b71-bf03-070f5c566768): created successfully Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d5b92f-4f32-4dfa-ad2f-e125a843c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Flow 'volume_create_manager' (41ba1c13-d508-467a-9118-3c1be6f4135d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9473817b-650b-4281-b80d-28ed970ee93f tempest-VolumeQuotasAdminTestJSON-669622523 None] Created volume successfully. Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Acquiring lock "cinder-quobyte-ad6e3551-514d-4bf2-9d01-2064a7518ed0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "cinder-quobyte-ad6e3551-514d-4bf2-9d01-2064a7518ed0" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769486e-3410-435c-8199-03f6c6807791]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:33 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:39:33 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:34 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.627s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:34 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0 Nov 02 12:39:34 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b05a7d68-b26c-4450-8895-8e55417f3496 tempest-VolumeQuotasAdminTestJSON-2029627014 None] Transfer volume completed successfully. Nov 02 12:39:34 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ad6e3551-514d-4bf2-9d01-2064a7518ed0" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "cinder-quobyte-ad6e3551-514d-4bf2-9d01-2064a7518ed0" released by "delete_volume" :: held 1.060s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Created reservations ['56009ca6-fa4b-456e-8fde-53fc772b0b71', '6e29a304-4a02-4f9e-aa29-b1ec13d6ab21', '45e6ce30-dce2-439f-a898-1f31956e78c6', '210d10b7-9992-4005-820c-dcf2e09c4e8f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:34 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:34 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Acquiring lock "cinder-a1f9b256-75a6-4b71-bf03-070f5c566768-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "cinder-a1f9b256-75a6-4b71-bf03-070f5c566768-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:35 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Acquiring lock "cinder-quobyte-a1f9b256-75a6-4b71-bf03-070f5c566768" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Deleted volume successfully. Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "cinder-quobyte-a1f9b256-75a6-4b71-bf03-070f5c566768" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f887770-1107-49e2-824e-58b316411760 tempest-VolumesActionsTest-78690998 None] Lock "cinder-ad6e3551-514d-4bf2-9d01-2064a7518ed0-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71fcbf-64b2-482c-b4f1-e8cf1bf9ed2b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:35 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 Nov 02 12:39:35 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:35 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:35 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768 Nov 02 12:39:35 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:35 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a1f9b256-75a6-4b71-bf03-070f5c566768" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "cinder-quobyte-a1f9b256-75a6-4b71-bf03-070f5c566768" released by "delete_volume" :: held 0.778s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Created reservations ['b070e8eb-be34-4b09-b093-48f944b7f1c7', 'e110228c-de84-491c-b6d7-fd3f7be47657', '7e38be07-dbee-41f3-bcac-5a092b96f386', '059788a9-0ce5-4843-b651-ffbb55eb7e62'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:36 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:36 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:36 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:36 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Deleted volume successfully. Nov 02 12:39:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4260eb5-566e-4319-8ae5-723e30a1f28a tempest-VolumeQuotasAdminTestJSON-363102161 None] Lock "cinder-a1f9b256-75a6-4b71-bf03-070f5c566768-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=39,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=36,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-054d8584-3499-40c0-8da5-d723138a7f21 req-34f6d88d-a486-4fd1-9c85-489a9aaf0875 tempest-ServerActionsTestOtherA-646512174 None] Terminate volume connection completed successfully. Nov 02 12:39:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-054d8584-3499-40c0-8da5-d723138a7f21 req-34f6d88d-a486-4fd1-9c85-489a9aaf0875 tempest-ServerActionsTestOtherA-646512174 None] Deleting attachment e8cf8998-fb6f-4866-8db4-d828544f0b36. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (54eebc22-cc66-46d9-822f-d9be3d152f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bf4a97-d4f1-4300-9814-6c8be9e039d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bf4a97-d4f1-4300-9814-6c8be9e039d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1643581823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9dbd7f-f9e0-4140-9fad-4591bc709aaf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:48Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb11ba-1089-4878-a282-9c7d89055361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb11ba-1089-4878-a282-9c7d89055361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c750d8-9cfc-45de-b454-99f287468291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c750d8-9cfc-45de-b454-99f287468291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9dbd7f-f9e0-4140-9fad-4591bc709aaf', 'volume_name': 'volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31788c06-6dd2-4297-9fcc-3179a639db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31788c06-6dd2-4297-9fcc-3179a639db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0a0697-cef2-499b-b1ba-ccca385b23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Volume 2e9dbd7f-f9e0-4140-9fad-4591bc709aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf', 'volume_size': 1} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1643581823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9dbd7f-f9e0-4140-9fad-4591bc709aaf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:48Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Creating volume 2e9dbd7f-f9e0-4140-9fad-4591bc709aaf {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:48 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf 1073741824 Nov 02 12:39:48 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:49 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf 1073741824" returned: 0 in 0.918s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:49 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf Nov 02 12:39:49 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:49 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0a0697-cef2-499b-b1ba-ccca385b23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6af487-a3cb-4dc4-819d-c99f85eb06be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Volume volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf (2e9dbd7f-f9e0-4140-9fad-4591bc709aaf): created successfully Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6af487-a3cb-4dc4-819d-c99f85eb06be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (54eebc22-cc66-46d9-822f-d9be3d152f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6fd3cadb-4c2c-48cc-91ea-5f80d1b20e24 tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Flow 'volume_create_manager' (e9113b98-3f62-4e45-afa8-55e90a2a2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ccb7e7-f736-4288-9a81-14ff75b07191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ccb7e7-f736-4288-9a81-14ff75b07191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1623141695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8586e17-6690-4596-bb19-f7de3de1ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b10c94a45054148b54ce660cb87c62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:50Z,use_quota=True,user_id='f90c0182be7543f38e9fcf68093148f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bfa2e0-1b6c-462a-adf4-2a666d4641fc),volume_type_id=39bfa2e0-1b6c-462a-adf4-2a666d4641fc)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd8adc-3a84-45f4-9f87-d5b37829dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd8adc-3a84-45f4-9f87-d5b37829dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf19b42-8dc8-4abd-be0b-2383d4859334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf19b42-8dc8-4abd-be0b-2383d4859334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8586e17-6690-4596-bb19-f7de3de1ba54', 'volume_name': 'volume-a8586e17-6690-4596-bb19-f7de3de1ba54', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcabfe06-9463-4116-9e71-fe15af270be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcabfe06-9463-4116-9e71-fe15af270be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd67b52a-74b4-4275-b575-5221f84d402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Volume a8586e17-6690-4596-bb19-f7de3de1ba54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8586e17-6690-4596-bb19-f7de3de1ba54', 'volume_size': 1} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1623141695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8586e17-6690-4596-bb19-f7de3de1ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b10c94a45054148b54ce660cb87c62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:50Z,use_quota=True,user_id='f90c0182be7543f38e9fcf68093148f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39bfa2e0-1b6c-462a-adf4-2a666d4641fc),volume_type_id=39bfa2e0-1b6c-462a-adf4-2a666d4641fc)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Creating volume a8586e17-6690-4596-bb19-f7de3de1ba54 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:50 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 1073741824 Nov 02 12:39:50 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:51 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 1073741824" returned: 0 in 0.817s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:51 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 Nov 02 12:39:51 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:51 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (fe8ba291-e3b9-4046-ba67-f75d513efc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa8fcb4-22e7-443f-ae0a-6d3ca8e69617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa8fcb4-22e7-443f-ae0a-6d3ca8e69617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-107796760',display_name='tempest-VolumesGetTest-Volume-562939618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b476b18c-2974-48b0-a2ba-037be5d88d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:52Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8afb8de-040e-453d-b770-fceaf4a0bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8afb8de-040e-453d-b770-fceaf4a0bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6356db2-0d83-4612-b96e-102ff750549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6356db2-0d83-4612-b96e-102ff750549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b476b18c-2974-48b0-a2ba-037be5d88d25', 'volume_name': 'volume-b476b18c-2974-48b0-a2ba-037be5d88d25', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9734d7-8c52-4055-b789-a1686e006b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9734d7-8c52-4055-b789-a1686e006b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813df06-5914-431e-8921-b8e2d75ac385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Volume b476b18c-2974-48b0-a2ba-037be5d88d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b476b18c-2974-48b0-a2ba-037be5d88d25', 'volume_size': 1} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-107796760',display_name='tempest-VolumesGetTest-Volume-562939618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b476b18c-2974-48b0-a2ba-037be5d88d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:52Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Creating volume b476b18c-2974-48b0-a2ba-037be5d88d25 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd67b52a-74b4-4275-b575-5221f84d402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8586e17-6690-4596-bb19-f7de3de1ba54', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067346a6-f0b5-47df-be03-547adbfb58d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 1073741824 Nov 02 12:39:51 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Volume volume-a8586e17-6690-4596-bb19-f7de3de1ba54 (a8586e17-6690-4596-bb19-f7de3de1ba54): created successfully Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067346a6-f0b5-47df-be03-547adbfb58d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Flow 'volume_create_manager' (e9113b98-3f62-4e45-afa8-55e90a2a2c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-15a07a23-e6ba-488f-a419-f677fc75984c tempest-VolumeTypesAccessTest-1098778920 None] Created volume successfully. Nov 02 12:39:52 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 1073741824" returned: 0 in 0.566s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 Nov 02 12:39:52 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Acquiring lock "cinder-a8586e17-6690-4596-bb19-f7de3de1ba54-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "cinder-a8586e17-6690-4596-bb19-f7de3de1ba54-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Acquiring lock "cinder-quobyte-a8586e17-6690-4596-bb19-f7de3de1ba54" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "cinder-quobyte-a8586e17-6690-4596-bb19-f7de3de1ba54" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf28104-307d-4123-b927-6ee5618f6b77]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6813df06-5914-431e-8921-b8e2d75ac385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b476b18c-2974-48b0-a2ba-037be5d88d25', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5a8003-4f45-4a8a-9a79-70ec7598c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Volume volume-b476b18c-2974-48b0-a2ba-037be5d88d25 (b476b18c-2974-48b0-a2ba-037be5d88d25): created successfully Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5a8003-4f45-4a8a-9a79-70ec7598c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (fe8ba291-e3b9-4046-ba67-f75d513efc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2af26b42-963f-4600-a9a2-3fb4df473ca9 tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:39:52 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 Nov 02 12:39:52 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54" returned: 0 in 0.476s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54 Nov 02 12:39:53 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a8586e17-6690-4596-bb19-f7de3de1ba54" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "cinder-quobyte-a8586e17-6690-4596-bb19-f7de3de1ba54" released by "delete_volume" :: held 0.804s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:53 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1982702093 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1982702093, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:39:53 devstack cinder-volume[86731]: WARNING cinder.quota [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1982702093 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1982702093, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Created reservations ['7c36582d-6102-4156-aae9-a3511f81fdfb', 'd422bf34-5370-4a08-bca8-5dfb926f75c6', '09466a41-2918-4595-9618-1e04d90e021d', '44209e75-663b-4836-b337-4e1e81dcf711'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:53 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-b476b18c-2974-48b0-a2ba-037be5d88d25-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "cinder-b476b18c-2974-48b0-a2ba-037be5d88d25-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.476s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Deleted volume successfully. Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-b476b18c-2974-48b0-a2ba-037be5d88d25" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-b476b18c-2974-48b0-a2ba-037be5d88d25" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2fa19d1d-4c43-424b-a870-58601774e57c tempest-VolumeTypesAccessTest-1098778920 None] Lock "cinder-a8586e17-6690-4596-bb19-f7de3de1ba54-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[861696ab-a533-4c14-b6fd-1fc9b6f92cf3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:54 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 Nov 02 12:39:54 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:54 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:54 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25 Nov 02 12:39:54 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b476b18c-2974-48b0-a2ba-037be5d88d25" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-b476b18c-2974-48b0-a2ba-037be5d88d25" released by "delete_volume" :: held 0.811s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Flow 'volume_create_manager' (b8834928-c56c-4dea-a0f3-1ff038a34e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce2c32-96cb-4961-842f-bdbe1034c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce2c32-96cb-4961-842f-bdbe1034c237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-957205290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f36cee4-bca2-446e-9d58-5d564c07601d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf25390e7f60489aa44cbdd205ddf1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:55Z,use_quota=True,user_id='73d61da699e54b25af7c45ff82938faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1102d17-44cc-4ffa-94d5-ec0bc850dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1102d17-44cc-4ffa-94d5-ec0bc850dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe76d8f8-8eec-4e81-bd57-407166de6371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Created reservations ['95fe7408-2754-4626-93d1-3a54fec31de2', '8271b1e3-bc7a-4d67-8ff0-f9e52529e9fd', '7486fd8f-067f-48bc-83a1-bb905ed3555b', '0460464a-ef8a-41af-a9fa-58caa9da4a42'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:55 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98de14b1-e820-429c-8bec-d19b9d7e6b75 tempest-VolumesGetTest-350316678 None] Lock "cinder-b476b18c-2974-48b0-a2ba-037be5d88d25-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe76d8f8-8eec-4e81-bd57-407166de6371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f36cee4-bca2-446e-9d58-5d564c07601d', 'volume_name': 'volume-5f36cee4-bca2-446e-9d58-5d564c07601d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49843f1-5715-4621-9412-7cc6f5389fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49843f1-5715-4621-9412-7cc6f5389fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7c2b6-70f3-4bf9-8d30-c1440941ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Volume 5f36cee4-bca2-446e-9d58-5d564c07601d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f36cee4-bca2-446e-9d58-5d564c07601d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:39:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Trying to clone 5f36cee4-bca2-446e-9d58-5d564c07601d from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:39:56 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e78531-6d6e-4e89-ac0f-85c801003449]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:56 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD Nov 02 12:39:56 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "cinder-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:56 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbeebb9-b892-479a-bbd5-6ae38dcf6fd1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b is fetched for user 73d61da699e54b25af7c45ff82938faf. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacc179e-9174-4b4e-ab19-7b67bad1e36b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:56 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf Nov 02 12:39:56 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:56 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD Nov 02 12:39:56 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:56 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:57 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf Nov 02 12:39:57 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:57 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-957205290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f36cee4-bca2-446e-9d58-5d564c07601d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf25390e7f60489aa44cbdd205ddf1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:55Z,use_quota=True,user_id='73d61da699e54b25af7c45ff82938faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Creating volume 5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:57 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1073741824 Nov 02 12:39:57 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:57 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf" released by "delete_volume" :: held 0.749s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Created reservations ['bf8c8f49-52c9-4721-ba9e-9e2198786261', 'da1d1027-e226-464a-83ae-1878b0252087', 'b31fcf4a-1fd6-42fb-83ea-13f708a53cb3', '39086010-bad9-4ba8-91e5-9db7c85e9df2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:57 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:39:57 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:57 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1073741824" returned: 0 in 0.571s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:57 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d Nov 02 12:39:57 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:57 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:39:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a81c6e0b-b53c-420d-b85d-9fd2e6a1f316 tempest-VolumesGetTest-350316678 None] Lock "cinder-2e9dbd7f-f9e0-4140-9fad-4591bc709aaf-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:58 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Attempting download of 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 5f36cee4-bca2-446e-9d58-5d564c07601d. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd2fcab-5f87-4588-80d6-e8db81dbb878]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (51550708-3611-4337-be09-2d3c9978a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9364eee8-c29c-45be-b132-1d76e4458d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9364eee8-c29c-45be-b132-1d76e4458d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1481429283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:58Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322e05e0-afea-4b90-8d62-9fb48f14647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:58 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0 Nov 02 12:39:58 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322e05e0-afea-4b90-8d62-9fb48f14647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea300da-f974-4031-a3fb-cb5726736c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea300da-f974-4031-a3fb-cb5726736c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'volume_name': 'volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20470029-f527-4dd9-901e-665c5ff387d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20470029-f527-4dd9-901e-665c5ff387d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e720853-9025-4c52-99d3-d6e57d61cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Volume 3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'volume_size': 1} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1481429283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:58Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Creating volume 3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:58 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 1073741824 Nov 02 12:39:58 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:58 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:58 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0 Nov 02 12:39:58 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:58 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 1073741824" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:58 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:58 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:39:58 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0" returned: 1 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_86_xy3r0' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8283c475-3268-40ec-8bb7-2fa6b2674e1c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:59 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD Nov 02 12:39:59 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:59 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e720853-9025-4c52-99d3-d6e57d61cfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f36f77-10e6-49b2-b936-9259c2709798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Volume volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 (3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6): created successfully Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f36f77-10e6-49b2-b936-9259c2709798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (51550708-3611-4337-be09-2d3c9978a134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e036dedf-c33f-4f63-a3ea-e4eee0438fc4 tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:39:59 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:39:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:59 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d Nov 02 12:39:59 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (3e1fffcb-cf25-4d8b-94a3-4c5c83957fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81052654-1649-4e77-b8f8-7efa9e70489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81052654-1649-4e77-b8f8-7efa9e70489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1036658295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047debad-ea08-4181-b028-ab28b1fc2abe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:01Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98897212-82e0-454e-83f0-c457b58e70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98897212-82e0-454e-83f0-c457b58e70b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e38367a-50d9-4fba-8e4e-f5ec01fcab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e38367a-50d9-4fba-8e4e-f5ec01fcab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '047debad-ea08-4181-b028-ab28b1fc2abe', 'volume_name': 'volume-047debad-ea08-4181-b028-ab28b1fc2abe', 'volume_size': 1, 'source_volid': '3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df27e9-abbb-4424-8bbb-552a7ab4e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df27e9-abbb-4424-8bbb-552a7ab4e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955288ba-f3d6-4e5a-9266-ab135816501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Volume 047debad-ea08-4181-b028-ab28b1fc2abe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-047debad-ea08-4181-b028-ab28b1fc2abe', 'volume_size': 1, 'source_volid': '3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'source_volstatus': 'available'} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:01 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Cloning volume 3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 to volume 047debad-ea08-4181-b028-ab28b1fc2abe Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Creating offline snapshot c2339a80-71b7-49d5-a051-843ec925dd17 of volume 3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9937e-48f5-4f30-96a8-df614e3aa289]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:01 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:40:01 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:01 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:01 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 1G Nov 02 12:40:01 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:01 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d" returned: 0 in 2.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_j25753kcdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:40:01 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Converted 112.00 MB image at 44.59 MB/s Nov 02 12:40:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:01 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1G Nov 02 12:40:01 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:02 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 1G" returned: 0 in 0.570s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:02 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d 1G" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Downloaded image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 5f36cee4-bca2-446e-9d58-5d564c07601d successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:40:02 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:02 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b for user 73d61da699e54b25af7c45ff82938faf is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Marking volume 5f36cee4-bca2-446e-9d58-5d564c07601d as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Copying metadata from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b to 5f36cee4-bca2-446e-9d58-5d564c07601d. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Creating volume glance metadata for volume 5f36cee4-bca2-446e-9d58-5d564c07601d backed by image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7c2b6-70f3-4bf9-8d30-c1440941ace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f36cee4-bca2-446e-9d58-5d564c07601d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ce3fb-4ece-4109-8af1-c7240828e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Volume volume-5f36cee4-bca2-446e-9d58-5d564c07601d (5f36cee4-bca2-446e-9d58-5d564c07601d): created successfully Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ce3fb-4ece-4109-8af1-c7240828e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Flow 'volume_create_manager' (b8834928-c56c-4dea-a0f3-1ff038a34e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6e973ab7-447f-4dca-88ae-4ac181e91366 tempest-ServerActionsTestOtherA-646512174 None] Created volume successfully. Nov 02 12:40:02 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:02 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 is being set with open permissions: ugo+rw Nov 02 12:40:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:02 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:02 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-e31ad592-9d55-4dd1-8f86-b332b5955c06 req-53e8ddb6-be76-4eb7-aff5-d84b9e9bcd89 tempest-AttachVolumeTestJSON-1043400045 None] Terminate volume connection completed successfully. Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-e31ad592-9d55-4dd1-8f86-b332b5955c06 req-53e8ddb6-be76-4eb7-aff5-d84b9e9bcd89 tempest-AttachVolumeTestJSON-1043400045 None] Deleting attachment 6bbc46e5-8ccb-42a4-a0c3-09a3e31ed33e. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info Nov 02 12:40:03 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:03 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info is being set with open permissions: ugo+rw Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info Nov 02 12:40:03 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.info" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] snapshot: c2339a80-71b7-49d5-a051-843ec925dd17, volume: 047debad-ea08-4181-b028-ab28b1fc2abe, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b6d9d-a8e9-4098-9530-274923b83d39]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:03 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:04 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.569s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057fae2-5985-444a-a6c5-8b952c9f222f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:04 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:40:04 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:04 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:40:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:04 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe Nov 02 12:40:04 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b77f4af0-181f-46d3-a85d-af47e2809526 req-1b5933aa-096e-447f-9dda-55b9976cfaf4 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:16 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe" returned: 0 in 11.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6, size 1024.00 MB, duration 11.34 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:40:16 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Converted 1024.00 MB image at 90.27 MB/s Nov 02 12:40:16 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe is being set with open permissions: ugo+rw Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:16 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe Nov 02 12:40:16 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:16 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" released by "_copy_volume_from_snapshot" :: held 12.924s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-c2339a80-71b7-49d5-a051-843ec925dd17" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-c2339a80-71b7-49d5-a051-843ec925dd17" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Deleting offline snapshot c2339a80-71b7-49d5-a051-843ec925dd17 of volume 3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] snapshot_file for this snap is: volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9887b2ea-7454-4cf7-9509-4e9ca95bf917]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:16 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:16 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:17 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.489s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:40:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50adf550-6d21-455c-9eff-74adaeb4e6b6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:17 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:40:17 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:18 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.747s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:18 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:18 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:18 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:18 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17 Nov 02 12:40:18 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:18 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6.c2339a80-71b7-49d5-a051-843ec925dd17" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-c2339a80-71b7-49d5-a051-843ec925dd17" released by "_delete_snapshot" :: held 2.065s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.619s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b77f4af0-181f-46d3-a85d-af47e2809526 req-1b5933aa-096e-447f-9dda-55b9976cfaf4 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.393s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b77f4af0-181f-46d3-a85d-af47e2809526 req-1b5933aa-096e-447f-9dda-55b9976cfaf4 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955288ba-f3d6-4e5a-9266-ab135816501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047debad-ea08-4181-b028-ab28b1fc2abe', 'volume_size': 1, 'source_volid': '3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f37166-855e-46b5-aa0a-771344d60eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Volume volume-047debad-ea08-4181-b028-ab28b1fc2abe (047debad-ea08-4181-b028-ab28b1fc2abe): created successfully Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f37166-855e-46b5-aa0a-771344d60eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (3e1fffcb-cf25-4d8b-94a3-4c5c83957fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-b77f4af0-181f-46d3-a85d-af47e2809526 req-1b5933aa-096e-447f-9dda-55b9976cfaf4 tempest-ServerActionsTestOtherA-646512174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-5f36cee4-bca2-446e-9d58-5d564c07601d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6107232b-783a-447a-92f6-52db8383d738', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:40:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-440bdb7f-f351-4968-bffc-bace8dffa5f4 tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:40:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b77f4af0-181f-46d3-a85d-af47e2809526 req-1b5933aa-096e-447f-9dda-55b9976cfaf4 tempest-ServerActionsTestOtherA-646512174 None] attachment_update completed successfully. Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (793f2ac1-db87-4e8b-bb0f-8a5d757249ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c088a7-046d-4dfd-a804-fcb6165d75ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c088a7-046d-4dfd-a804-fcb6165d75ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399902327',display_name='tempest-VolumesGetTest-Volume-1319238832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00159e17-1ea7-460c-b489-bc33858cca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:22Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deeb70b-2e75-4dba-977f-ff424b7bf86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deeb70b-2e75-4dba-977f-ff424b7bf86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e6ce84-3034-4da4-bb4d-8c33f3f22108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e6ce84-3034-4da4-bb4d-8c33f3f22108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00159e17-1ea7-460c-b489-bc33858cca53', 'volume_name': 'volume-00159e17-1ea7-460c-b489-bc33858cca53', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928ac680-6361-464a-8527-c9fcdc1c773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928ac680-6361-464a-8527-c9fcdc1c773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5385451-a24f-4f6c-b07b-72f8a3f668f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Volume 00159e17-1ea7-460c-b489-bc33858cca53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00159e17-1ea7-460c-b489-bc33858cca53', 'volume_size': 1} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-399902327',display_name='tempest-VolumesGetTest-Volume-1319238832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00159e17-1ea7-460c-b489-bc33858cca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:22Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Creating volume 00159e17-1ea7-460c-b489-bc33858cca53 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:21 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:21 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 1073741824 Nov 02 12:40:21 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:22 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 1073741824" returned: 0 in 1.018s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:23 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 Nov 02 12:40:23 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:23 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5385451-a24f-4f6c-b07b-72f8a3f668f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00159e17-1ea7-460c-b489-bc33858cca53', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977702e-1e9f-4e7a-aa93-5c2aa20baf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Volume volume-00159e17-1ea7-460c-b489-bc33858cca53 (00159e17-1ea7-460c-b489-bc33858cca53): created successfully Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8977702e-1e9f-4e7a-aa93-5c2aa20baf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (793f2ac1-db87-4e8b-bb0f-8a5d757249ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-76ee4ace-f4d9-41aa-83f2-f89be1ea273b tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-00159e17-1ea7-460c-b489-bc33858cca53-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "cinder-00159e17-1ea7-460c-b489-bc33858cca53-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-00159e17-1ea7-460c-b489-bc33858cca53" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-00159e17-1ea7-460c-b489-bc33858cca53" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ef1441-56dc-49ad-8c4f-8ab5b379fdf3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:24 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 Nov 02 12:40:24 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:25 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53" returned: 0 in 0.825s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:25 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53 Nov 02 12:40:25 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:26 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-00159e17-1ea7-460c-b489-bc33858cca53" returned: 0 in 0.507s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-00159e17-1ea7-460c-b489-bc33858cca53" released by "delete_volume" :: held 1.432s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Created reservations ['87f75b37-b46a-4087-aa5f-da994933adba', 'ca40a0bd-612b-415b-afac-8696be473c87', '9b7a7794-6fc7-4dad-afba-4cd4cdb65314', '2367b82e-7417-400e-af70-cbbdc146b222'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:26 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:26 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:26 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:40:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe9c35bc-6da7-4227-9e85-f800ce7d91f2 tempest-VolumesGetTest-350316678 None] Lock "cinder-00159e17-1ea7-460c-b489-bc33858cca53-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-047debad-ea08-4181-b028-ab28b1fc2abe-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "cinder-047debad-ea08-4181-b028-ab28b1fc2abe-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd85a8-f8ce-4acb-ad34-0f7416744618]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:27 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe Nov 02 12:40:27 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:27 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe" returned: 0 in 0.534s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:27 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe Nov 02 12:40:27 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:28 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-047debad-ea08-4181-b028-ab28b1fc2abe" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-047debad-ea08-4181-b028-ab28b1fc2abe" released by "delete_volume" :: held 1.151s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Created reservations ['beaf6336-c532-4eb9-a5cc-6e5a9ac71993', '3028051b-50a6-4400-b9e2-9bdc0fc930fc', 'd8979418-7c80-4d6c-97f9-6be6b91e8ce3', '4c44ca02-ce34-4bf9-abc4-d4071a7645e0'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:28 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:28 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:28 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:29 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:29 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85e82169-956e-45a7-a725-af8b81c647e2 tempest-VolumesGetTest-350316678 None] Lock "cinder-047debad-ea08-4181-b028-ab28b1fc2abe-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:29 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.594s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "cinder-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" acquired by "delete_volume" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bea90b-fa1f-4f96-9e44-dde55830d842]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:30 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:40:30 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:30 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.570s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:30 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6 Nov 02 12:40:30 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:31 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6" released by "delete_volume" :: held 1.252s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Created reservations ['1f8e21de-f124-4d8f-b713-7e6a9ff5c80f', '29f6f2d8-6a5f-4dc1-9d1a-7ccf4dc8d760', '925142f3-ec52-4338-9fdc-0f66aca99f18', 'fe746b26-633c-4ff5-8925-866355e95304'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:31 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:31 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:31 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:40:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-df7314da-2119-4801-a25b-a1d70c0a9cb1 tempest-VolumesGetTest-350316678 None] Lock "cinder-3bc2b2b0-fd46-452e-b8b3-5a47be9d66e6-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (ad1df616-a099-4f0c-a32f-e944ebdf3952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e92aa9-dd5b-4c62-94c5-3854d84d51b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e92aa9-dd5b-4c62-94c5-3854d84d51b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1414897525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5ff391-b45b-4012-935f-60350db5a066,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:34Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ea8d95-cc05-4ab5-95c0-9efab20aa379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ea8d95-cc05-4ab5-95c0-9efab20aa379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31addde8-e83a-4703-9471-e1482f27e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:33 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31addde8-e83a-4703-9471-e1482f27e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d5ff391-b45b-4012-935f-60350db5a066', 'volume_name': 'volume-6d5ff391-b45b-4012-935f-60350db5a066', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a2bb9-a6d5-407e-9c7e-d4a2ce43e97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a2bb9-a6d5-407e-9c7e-d4a2ce43e97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d8df33-1fc0-433c-80ed-4e879be9c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Volume 6d5ff391-b45b-4012-935f-60350db5a066: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d5ff391-b45b-4012-935f-60350db5a066', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Trying to clone 6d5ff391-b45b-4012-935f-60350db5a066 from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:40:34 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:40:35 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d69c04-03b7-42c8-a88a-a411d9f8f35f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:35 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD Nov 02 12:40:35 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:35 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD" returned: 0 in 0.586s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b is fetched for user 78362533b027423dbb7d621ebd5f643e. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:40:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-5be477dc-fa42-4840-8845-423369b076d4 req-c8149150-5230-49e6-bc11-37a0c0863027 tempest-ServerActionsTestOtherA-646512174 None] Terminate volume connection completed successfully. Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-5be477dc-fa42-4840-8845-423369b076d4 req-c8149150-5230-49e6-bc11-37a0c0863027 tempest-ServerActionsTestOtherA-646512174 None] Deleting attachment 6107232b-783a-447a-92f6-52db8383d738. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4bf905-e06b-4871-8022-f96929b832de]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:36 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD Nov 02 12:40:36 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:36 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD" returned: 0 in 0.598s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1414897525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5ff391-b45b-4012-935f-60350db5a066,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:34Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Creating volume 6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:36 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1073741824 Nov 02 12:40:36 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:37 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1073741824" returned: 0 in 0.903s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:37 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 Nov 02 12:40:37 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:37 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Attempting download of 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 6d5ff391-b45b-4012-935f-60350db5a066. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[089ac950-93f4-459c-b345-1e63c3bbd0c6]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:38 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii Nov 02 12:40:38 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:38 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:38 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii Nov 02 12:40:38 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:38 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii" returned: 1 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_e6hwbuii' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c92ace-bac0-42cf-9415-b1d2380522e1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:38 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD Nov 02 12:40:38 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5be477dc-fa42-4840-8845-423369b076d4 req-1b0a19df-eb70-456f-84f1-c6d5a79721d9 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5be477dc-fa42-4840-8845-423369b076d4 req-1b0a19df-eb70-456f-84f1-c6d5a79721d9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5be477dc-fa42-4840-8845-423369b076d4 req-1b0a19df-eb70-456f-84f1-c6d5a79721d9 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-5be477dc-fa42-4840-8845-423369b076d4 req-1b0a19df-eb70-456f-84f1-c6d5a79721d9 tempest-ServerActionsTestOtherA-646512174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-5f36cee4-bca2-446e-9d58-5d564c07601d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90439aa8-12bc-4f64-b33d-38d3604fd1c4', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:40:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-5be477dc-fa42-4840-8845-423369b076d4 req-1b0a19df-eb70-456f-84f1-c6d5a79721d9 tempest-ServerActionsTestOtherA-646512174 None] attachment_update completed successfully. Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:39 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:39 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 Nov 02 12:40:39 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (7c035356-5c77-412d-9512-638c681b6954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8c1513-b165-4341-a647-8638b8ad9329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8c1513-b165-4341-a647-8638b8ad9329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-536618257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880983b4-a75b-4c86-a0d9-ce94d12347a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:40Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0bb61-a459-4d59-a054-255d8a078c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0bb61-a459-4d59-a054-255d8a078c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70701f9b-a230-4d1d-a826-afe518146985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70701f9b-a230-4d1d-a826-afe518146985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880983b4-a75b-4c86-a0d9-ce94d12347a0', 'volume_name': 'volume-880983b4-a75b-4c86-a0d9-ce94d12347a0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1648b87f-dec3-4268-884c-603c39a1fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1648b87f-dec3-4268-884c-603c39a1fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9cc71-11fb-4cbb-8d2f-4b3a61118c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Volume 880983b4-a75b-4c86-a0d9-ce94d12347a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880983b4-a75b-4c86-a0d9-ce94d12347a0', 'volume_size': 1} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-536618257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880983b4-a75b-4c86-a0d9-ce94d12347a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:40Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Creating volume 880983b4-a75b-4c86-a0d9-ce94d12347a0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:39 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:39 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 1073741824 Nov 02 12:40:39 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:40 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 1073741824" returned: 0 in 0.821s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:40 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 Nov 02 12:40:40 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:41 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d9cc71-11fb-4cbb-8d2f-4b3a61118c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880983b4-a75b-4c86-a0d9-ce94d12347a0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0613363e-3937-4730-a0ca-cd9e7c551a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Volume volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 (880983b4-a75b-4c86-a0d9-ce94d12347a0): created successfully Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0613363e-3937-4730-a0ca-cd9e7c551a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (7c035356-5c77-412d-9512-638c681b6954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bd8e4ec4-f941-439c-8a61-7f2df88924bb tempest-VolumesListAdminTestJSON-190248915 None] Created volume successfully. Nov 02 12:40:42 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066" returned: 0 in 2.986s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_5_txegf8devstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:40:42 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Converted 112.00 MB image at 37.47 MB/s Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:42 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1G Nov 02 12:40:42 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:42 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 1G" returned: 0 in 0.703s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Downloaded image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 6d5ff391-b45b-4012-935f-60350db5a066 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b for user 78362533b027423dbb7d621ebd5f643e is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Marking volume 6d5ff391-b45b-4012-935f-60350db5a066 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Copying metadata from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b to 6d5ff391-b45b-4012-935f-60350db5a066. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:40:42 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Creating volume glance metadata for volume 6d5ff391-b45b-4012-935f-60350db5a066 backed by image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (b4af7211-72a3-48da-a728-c7fb28853fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50cc54e-2443-4acf-927c-020fa345754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50cc54e-2443-4acf-927c-020fa345754b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1465308023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f6dcc5-799d-434f-ba24-0d92c9994635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:43Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16f6f58-0ddf-4283-9b34-827149ac8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16f6f58-0ddf-4283-9b34-827149ac8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2750d5-1424-4249-bcca-21d6cd352aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2750d5-1424-4249-bcca-21d6cd352aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f6dcc5-799d-434f-ba24-0d92c9994635', 'volume_name': 'volume-67f6dcc5-799d-434f-ba24-0d92c9994635', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ea9dd8-a5de-48e5-abfc-91292ea67dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ea9dd8-a5de-48e5-abfc-91292ea67dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baa202a-b472-4ab3-bc7b-5005d6629241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Volume 67f6dcc5-799d-434f-ba24-0d92c9994635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f6dcc5-799d-434f-ba24-0d92c9994635', 'volume_size': 1} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1465308023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f6dcc5-799d-434f-ba24-0d92c9994635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:43Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Creating volume 67f6dcc5-799d-434f-ba24-0d92c9994635 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:43 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 1073741824 Nov 02 12:40:43 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d8df33-1fc0-433c-80ed-4e879be9c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5ff391-b45b-4012-935f-60350db5a066', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec991f7-f082-433c-ae76-fa1497441adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Volume volume-6d5ff391-b45b-4012-935f-60350db5a066 (6d5ff391-b45b-4012-935f-60350db5a066): created successfully Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec991f7-f082-433c-ae76-fa1497441adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (ad1df616-a099-4f0c-a32f-e944ebdf3952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3ce5e21-4970-4976-a207-b21c58b7f9aa tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:40:43 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 1073741824" returned: 0 in 0.587s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:43 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 Nov 02 12:40:43 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:44 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baa202a-b472-4ab3-bc7b-5005d6629241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f6dcc5-799d-434f-ba24-0d92c9994635', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8de99e-f894-4145-b7a3-7cb904f0beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Volume volume-67f6dcc5-799d-434f-ba24-0d92c9994635 (67f6dcc5-799d-434f-ba24-0d92c9994635): created successfully Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8de99e-f894-4145-b7a3-7cb904f0beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (b4af7211-72a3-48da-a728-c7fb28853fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3e4a10e5-dfc8-4ab3-829d-a076b2a7257c tempest-VolumesListAdminTestJSON-190248915 None] Created volume successfully. Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (1cbe3423-c967-46f4-9680-898102765d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d590b50-9fe4-4aa3-825b-e6ded862f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d590b50-9fe4-4aa3-825b-e6ded862f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-152372210',display_name='tempest-VolumesGetTest-Volume-2101205454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85471280-bae0-473e-a526-de959bb51e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:45Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d27618-f2c1-435a-93be-8ba7204a8aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d27618-f2c1-435a-93be-8ba7204a8aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a7a1c1-98a3-47dd-a27f-8c49dd813760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a7a1c1-98a3-47dd-a27f-8c49dd813760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85471280-bae0-473e-a526-de959bb51e84', 'volume_name': 'volume-85471280-bae0-473e-a526-de959bb51e84', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2738f3-e855-40a7-a070-9bad877ad15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2738f3-e855-40a7-a070-9bad877ad15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c79304-8a60-4969-a2f3-437b75553319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Volume 85471280-bae0-473e-a526-de959bb51e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85471280-bae0-473e-a526-de959bb51e84', 'volume_size': 1} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-152372210',display_name='tempest-VolumesGetTest-Volume-2101205454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85471280-bae0-473e-a526-de959bb51e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37690daef1b4aa993d8e24047e4bfea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:45Z,use_quota=True,user_id='78362533b027423dbb7d621ebd5f643e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Creating volume 85471280-bae0-473e-a526-de959bb51e84 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:45 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:45 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 1073741824 Nov 02 12:40:45 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=82,cinder:UPDATE=88,cinder:INSERT=32,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (ad4d9213-2974-4f71-b1da-783a429db23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a08593-e07f-43bc-aa49-b39b0bf055dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a08593-e07f-43bc-aa49-b39b0bf055dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-71089489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8238ac-66dd-4b31-b08e-7a7cb8dff093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:46Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979cfef1-33f3-4957-95c6-d0ae2685e3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979cfef1-33f3-4957-95c6-d0ae2685e3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9be0b5-5853-4cf9-9eaa-76ebe74e84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9be0b5-5853-4cf9-9eaa-76ebe74e84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8238ac-66dd-4b31-b08e-7a7cb8dff093', 'volume_name': 'volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaef0aa-dc7f-4342-9f9b-db8ef6eecd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaef0aa-dc7f-4342-9f9b-db8ef6eecd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ae962f-c00c-4ca0-b3a8-1b4b24278c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Volume 9f8238ac-66dd-4b31-b08e-7a7cb8dff093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093', 'volume_size': 1} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:46 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 1073741824" returned: 0 in 1.077s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=91,cinder:UPDATE=87,cinder:DELETE=8,cinder:INSERT=30 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:46 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 Nov 02 12:40:46 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:46 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84" returned: 0 in 0.424s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-71089489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8238ac-66dd-4b31-b08e-7a7cb8dff093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2510740596842ea8298530106a502b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:46Z,use_quota=True,user_id='c1491c0906af49bf9e9d56a3ace27e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Creating volume 9f8238ac-66dd-4b31-b08e-7a7cb8dff093 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c79304-8a60-4969-a2f3-437b75553319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85471280-bae0-473e-a526-de959bb51e84', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:47 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 1073741824 Nov 02 12:40:47 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28ee9b3-1c2f-4def-8f56-32c18496b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Volume volume-85471280-bae0-473e-a526-de959bb51e84 (85471280-bae0-473e-a526-de959bb51e84): created successfully Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e28ee9b3-1c2f-4def-8f56-32c18496b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Flow 'volume_create_manager' (1cbe3423-c967-46f4-9680-898102765d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a91bc460-fba2-4c60-9868-2edc70feccd1 tempest-VolumesGetTest-350316678 None] Created volume successfully. Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-85471280-bae0-473e-a526-de959bb51e84-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "cinder-85471280-bae0-473e-a526-de959bb51e84-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:47 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 1073741824" returned: 0 in 0.838s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-85471280-bae0-473e-a526-de959bb51e84" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-85471280-bae0-473e-a526-de959bb51e84" acquired by "delete_volume" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511a4d5-ea61-4b85-8d73-63a60d1970c9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:48 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 Nov 02 12:40:48 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:48 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 Nov 02 12:40:48 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:48 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ae962f-c00c-4ca0-b3a8-1b4b24278c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56306080-75a5-4f51-8e05-2fc7292fe456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Volume volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 (9f8238ac-66dd-4b31-b08e-7a7cb8dff093): created successfully Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56306080-75a5-4f51-8e05-2fc7292fe456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Flow 'volume_create_manager' (ad4d9213-2974-4f71-b1da-783a429db23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a7a8a6de-3d70-48bb-b34b-9d944211165f tempest-VolumesListAdminTestJSON-190248915 None] Created volume successfully. Nov 02 12:40:48 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84" returned: 0 in 0.691s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:48 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84 Nov 02 12:40:48 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:49 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-85471280-bae0-473e-a526-de959bb51e84" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-85471280-bae0-473e-a526-de959bb51e84" released by "delete_volume" :: held 1.234s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Created reservations ['3450a9a9-35d7-40db-8b38-194bfc1db13e', '23cfdfb5-cd05-4fce-b66f-a77ba5fd5278', '1f4b1525-fa84-4f03-9f84-179cbcc635da', '38bbf711-e686-47de-ae14-cd327c95d1ce'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:49 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:49 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:49 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:40:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-43b826c6-ee63-41d5-8448-5ce580181729 tempest-VolumesGetTest-350316678 None] Lock "cinder-85471280-bae0-473e-a526-de959bb51e84-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-6d5ff391-b45b-4012-935f-60350db5a066-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "cinder-6d5ff391-b45b-4012-935f-60350db5a066-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Acquiring lock "cinder-quobyte-6d5ff391-b45b-4012-935f-60350db5a066" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-6d5ff391-b45b-4012-935f-60350db5a066" acquired by "delete_volume" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Flow 'volume_create_manager' (86a43a7f-27f2-426f-bf47-6bd4cfa0fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ab09d3-5a05-4fc4-b337-a1490a85cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b56a39-303e-4a10-b3f2-fc9429ef71aa]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ab09d3-5a05-4fc4-b337-a1490a85cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf06851-6b69-4dff-9931-14661c5f47c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f08abb8ae84c068ed25988a2926927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:51Z,use_quota=True,user_id='d146d3880e5942c7a79020a87754d622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dac9a35-c835-40d8-ad69-08ad229519bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dac9a35-c835-40d8-ad69-08ad229519bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f36299-4a74-4fe8-9554-237ab6f1673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f36299-4a74-4fe8-9554-237ab6f1673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf06851-6b69-4dff-9931-14661c5f47c8', 'volume_name': 'volume-ecf06851-6b69-4dff-9931-14661c5f47c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40823f39-b3ac-4c64-acbb-6cb4902cb728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40823f39-b3ac-4c64-acbb-6cb4902cb728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a1f019-cc14-46c4-9f64-668d73519c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Volume ecf06851-6b69-4dff-9931-14661c5f47c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf06851-6b69-4dff-9931-14661c5f47c8', 'volume_size': 1} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf06851-6b69-4dff-9931-14661c5f47c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f08abb8ae84c068ed25988a2926927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:51Z,use_quota=True,user_id='d146d3880e5942c7a79020a87754d622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Creating volume ecf06851-6b69-4dff-9931-14661c5f47c8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:40:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:50 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 1073741824 Nov 02 12:40:50 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:50 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 Nov 02 12:40:50 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:51 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066" returned: 0 in 0.504s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:51 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066 Nov 02 12:40:51 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:51 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 1073741824" returned: 0 in 0.524s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:51 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 Nov 02 12:40:51 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:51 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a1f019-cc14-46c4-9f64-668d73519c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf06851-6b69-4dff-9931-14661c5f47c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf9e94c-098f-4d45-a848-dec5a1b43af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Volume volume-ecf06851-6b69-4dff-9931-14661c5f47c8 (ecf06851-6b69-4dff-9931-14661c5f47c8): created successfully Nov 02 12:40:51 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf9e94c-098f-4d45-a848-dec5a1b43af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Flow 'volume_create_manager' (86a43a7f-27f2-426f-bf47-6bd4cfa0fff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5ff391-b45b-4012-935f-60350db5a066" returned: 0 in 0.499s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5299e741-36d6-4546-9e45-16d392156616 tempest-VolumesListAdminTestJSON-919880577 None] Created volume successfully. Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "cinder-quobyte-6d5ff391-b45b-4012-935f-60350db5a066" released by "delete_volume" :: held 1.112s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Created reservations ['687d337f-02ab-42e8-b126-759e60584fd2', 'f882963d-b58e-447f-bac7-b500b96147de', '326a8f5b-0f4a-404a-9fca-f9b41a59f298', '1c847d54-1f68-42d0-ae63-25edf7ff01e4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:51 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:51 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:52 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:52 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Deleted volume successfully. Nov 02 12:40:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-318a1ee3-6afe-400e-bcec-1d89aec3ee12 tempest-VolumesGetTest-350316678 None] Lock "cinder-6d5ff391-b45b-4012-935f-60350db5a066-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Acquiring lock "cinder-ecf06851-6b69-4dff-9931-14661c5f47c8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "cinder-ecf06851-6b69-4dff-9931-14661c5f47c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Acquiring lock "cinder-quobyte-ecf06851-6b69-4dff-9931-14661c5f47c8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "cinder-quobyte-ecf06851-6b69-4dff-9931-14661c5f47c8" acquired by "delete_volume" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f4d857-af1d-4fd9-b673-02e668c718f1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-9f8238ac-66dd-4b31-b08e-7a7cb8dff093-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-9f8238ac-66dd-4b31-b08e-7a7cb8dff093-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-quobyte-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" acquired by "delete_volume" :: waited 0.080s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[397dd706-81f1-4175-a74c-0d2d219bd2fc]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:54 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 Nov 02 12:40:54 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:54 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8" returned: 0 in 0.984s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:54 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 Nov 02 12:40:54 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:54 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8 Nov 02 12:40:54 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:55 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ecf06851-6b69-4dff-9931-14661c5f47c8" returned: 0 in 0.835s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "cinder-quobyte-ecf06851-6b69-4dff-9931-14661c5f47c8" released by "delete_volume" :: held 1.986s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:55 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" returned: 0 in 1.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:55 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093 Nov 02 12:40:55 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Created reservations ['09ac6ebc-c254-4b7a-bfe9-449ac2679649', '26998dd2-5a1f-4c20-9304-efa918475b13', '1ebcfbfd-d3b9-4558-8862-a800a77d31e9', '97d021cd-6fdf-488c-af16-be3b9d2ddcac'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:55 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:55 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:56 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:56 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" returned: 0 in 1.058s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.831s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-9f8238ac-66dd-4b31-b08e-7a7cb8dff093" released by "delete_volume" :: held 2.606s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Deleted volume successfully. Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-530154b9-8bd3-4b73-a07e-34265d9c3229 tempest-VolumesListAdminTestJSON-919880577 None] Lock "cinder-ecf06851-6b69-4dff-9931-14661c5f47c8-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Created reservations ['84740539-d9f6-4d35-b9ad-a304816f4050', 'da9d2d9f-b1ac-44a3-a420-de6503d10783', 'b8341c7b-dd95-4379-8c3b-e53d481686ef', '1ce89550-0251-442e-985b-b276c94631e3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:56 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:56 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:57 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.563s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Deleted volume successfully. Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e0cf19b4-38fa-4119-81ef-eca6421c7b8f tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-9f8238ac-66dd-4b31-b08e-7a7cb8dff093-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-67f6dcc5-799d-434f-ba24-0d92c9994635-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-67f6dcc5-799d-434f-ba24-0d92c9994635-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-quobyte-67f6dcc5-799d-434f-ba24-0d92c9994635" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-67f6dcc5-799d-434f-ba24-0d92c9994635" acquired by "delete_volume" :: waited 0.064s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de96e7b-5c74-4762-9604-39cd091a58f8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:58 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 Nov 02 12:40:58 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:58 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635" returned: 0 in 0.699s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:58 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635 Nov 02 12:40:58 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:59 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67f6dcc5-799d-434f-ba24-0d92c9994635" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-67f6dcc5-799d-434f-ba24-0d92c9994635" released by "delete_volume" :: held 1.314s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Created reservations ['2d658239-a9f1-4719-b4d4-2fd1bc79eeba', 'b6a0699d-60a5-4715-a772-15cee609ee34', '97765d65-48cf-4a68-92b2-e228deccc99c', '53dfaa22-e43f-4671-970e-2c2b1133e059'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:59 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:40:59 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:59 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Deleted volume successfully. Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f79c15c0-6c78-4331-8da1-561c3efeb9f8 tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-67f6dcc5-799d-434f-ba24-0d92c9994635-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-880983b4-a75b-4c86-a0d9-ce94d12347a0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-880983b4-a75b-4c86-a0d9-ce94d12347a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "cinder-quobyte-880983b4-a75b-4c86-a0d9-ce94d12347a0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-880983b4-a75b-4c86-a0d9-ce94d12347a0" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05e7fc-d93a-456e-a94d-044c7261c494]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:00 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 Nov 02 12:41:00 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:01 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0" returned: 0 in 0.607s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:01 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0 Nov 02 12:41:01 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:01 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-880983b4-a75b-4c86-a0d9-ce94d12347a0" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-quobyte-880983b4-a75b-4c86-a0d9-ce94d12347a0" released by "delete_volume" :: held 1.031s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Created reservations ['71fb97c1-eb1a-42a1-af71-d44dbc7a4de5', 'bc0b07aa-9ee2-46f2-bb0e-204b812f6b1c', 'cee4bcfb-e514-4a69-a5fb-079e3135ace6', 'd3879ab4-d273-4e68-8d4f-b7be113477c8'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:01 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:01 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Flow 'volume_create_manager' (0e425278-2b7a-4485-b6b0-4cce5cf444d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af7c74-6b43-41e9-bec2-bf1f42ab67aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af7c74-6b43-41e9-bec2-bf1f42ab67aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1563501714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263b7dba-fbc4-45e4-9e64-a93ae2e2bfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca8d90abced4b02b46ce3c46ab7b110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:02Z,use_quota=True,user_id='613dcc4dc82c4f53bb7b400c42130eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bf39cf-1597-4106-b646-79e98ace5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bf39cf-1597-4106-b646-79e98ace5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f936fc-c8a1-42a0-a750-576a43f515dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f936fc-c8a1-42a0-a750-576a43f515dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '263b7dba-fbc4-45e4-9e64-a93ae2e2bfba', 'volume_name': 'volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e8632b-b9ae-4012-8776-fd65f38a1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:02 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e8632b-b9ae-4012-8776-fd65f38a1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7d4fc4-61bd-4da1-8e48-2e08c86fc9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba', 'volume_size': 1} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1563501714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263b7dba-fbc4-45e4-9e64-a93ae2e2bfba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca8d90abced4b02b46ce3c46ab7b110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:02Z,use_quota=True,user_id='613dcc4dc82c4f53bb7b400c42130eea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Creating volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Deleted volume successfully. Nov 02 12:41:02 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba 1073741824 Nov 02 12:41:02 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e12700d-c65b-4448-934b-300f2afb2c6a tempest-VolumesListAdminTestJSON-190248915 None] Lock "cinder-880983b4-a75b-4c86-a0d9-ce94d12347a0-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:02 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba 1073741824" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:02 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba Nov 02 12:41:02 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:03 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7d4fc4-61bd-4da1-8e48-2e08c86fc9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d46c38d-daa7-4d6e-bc5a-184683db3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Volume volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba (263b7dba-fbc4-45e4-9e64-a93ae2e2bfba): created successfully Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d46c38d-daa7-4d6e-bc5a-184683db3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Flow 'volume_create_manager' (0e425278-2b7a-4485-b6b0-4cce5cf444d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4bf00c64-3a79-4ddf-880f-acfa5ce2f9a1 tempest-VolumesSnapshotListTestJSON-1765377011 None] Created volume successfully. Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Creating offline snapshot ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f277db-9bb1-4007-9625-60a377e75ca5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:04 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba Nov 02 12:41:04 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:04 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:04 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 1G Nov 02 12:41:04 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:05 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 1G" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:05 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:05 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:05 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:05 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 is being set with open permissions: ugo+rw Nov 02 12:41:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:05 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:05 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:06 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:06 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info Nov 02 12:41:06 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:06 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info is being set with open permissions: ugo+rw Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:06 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info Nov 02 12:41:06 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:06 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.info" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e51f023-a77f-440e-be5a-fe634f8c1587 tempest-VolumesSnapshotListTestJSON-1765377011 None] Create snapshot completed successfully Nov 02 12:41:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Creating offline snapshot 34c94b65-ee17-47a3-890c-2d53d7628245 of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:41:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64dcfa3-c906-4fdd-8bfe-197410402b7a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:08 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:08 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Flow 'volume_create_manager' (236afd43-914c-40de-9992-ac4e93e10b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31e83b-1f56-459a-a981-fb7961fbb654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31e83b-1f56-459a-a981-fb7961fbb654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-85052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57047f95-3f83-448c-baed-4b36be8505e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e387d071735842c5865928117a11cba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:08Z,use_quota=True,user_id='9a5ff37b3e874728818c14fa7cbeb829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bd6940-14c0-4c14-b7c9-0dd44ee5a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bd6940-14c0-4c14-b7c9-0dd44ee5a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb6078-797e-4a14-9cde-87ddfd4e27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbeb6078-797e-4a14-9cde-87ddfd4e27bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57047f95-3f83-448c-baed-4b36be8505e5', 'volume_name': 'volume-57047f95-3f83-448c-baed-4b36be8505e5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eee7fdd-0ea4-45ac-be88-02a4cc3eb9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eee7fdd-0ea4-45ac-be88-02a4cc3eb9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994ce92b-3c52-421f-af54-43f44bcad959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Volume 57047f95-3f83-448c-baed-4b36be8505e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57047f95-3f83-448c-baed-4b36be8505e5', 'volume_size': 1} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:08 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:08 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 1G Nov 02 12:41:08 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:08 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 1G" returned: 0 in 0.483s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:08 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:08 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:09 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:09 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 is being set with open permissions: ugo+rw Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:09 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:09 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:09 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-85052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57047f95-3f83-448c-baed-4b36be8505e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e387d071735842c5865928117a11cba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:08Z,use_quota=True,user_id='9a5ff37b3e874728818c14fa7cbeb829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Creating volume 57047f95-3f83-448c-baed-4b36be8505e5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:09 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:09 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 1073741824 Nov 02 12:41:09 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a115072f-cac0-4b32-85c4-95a5bbd6bef6 tempest-VolumesSnapshotListTestJSON-1765377011 None] Create snapshot completed successfully Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:10 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 1073741824" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:10 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 Nov 02 12:41:10 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:10 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.303s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Creating offline snapshot f83be5f5-43a8-45dc-bc13-6372c559bf9b of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994ce92b-3c52-421f-af54-43f44bcad959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57047f95-3f83-448c-baed-4b36be8505e5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7139cbf-e489-4a8f-96a2-22b4d5db1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[569c6be0-fab9-4e11-920e-b24dc6149bb2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Volume volume-57047f95-3f83-448c-baed-4b36be8505e5 (57047f95-3f83-448c-baed-4b36be8505e5): created successfully Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7139cbf-e489-4a8f-96a2-22b4d5db1291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Flow 'volume_create_manager' (236afd43-914c-40de-9992-ac4e93e10b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0db1ff52-8dd6-4f65-8e9f-63695e392e60 tempest-VolumesMetadataTest-598861000 None] Created volume successfully. Nov 02 12:41:10 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:10 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:10 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:10 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b 1G Nov 02 12:41:10 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:11 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b 1G" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:11 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b Nov 02 12:41:11 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:11 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b is being set with open permissions: ugo+rw Nov 02 12:41:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:11 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b Nov 02 12:41:11 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:12 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.640s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fd4c3eab-e930-484e-a9e2-8588b2a4f9b4 tempest-VolumesSnapshotListTestJSON-1765377011 None] Create snapshot completed successfully Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Acquiring lock "cinder-57047f95-3f83-448c-baed-4b36be8505e5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "cinder-57047f95-3f83-448c-baed-4b36be8505e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Acquiring lock "cinder-quobyte-57047f95-3f83-448c-baed-4b36be8505e5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "cinder-quobyte-57047f95-3f83-448c-baed-4b36be8505e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128dab5-781d-4ff9-ba9d-1997e06ade13]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:12 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 Nov 02 12:41:12 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:12 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:12 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5 Nov 02 12:41:12 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:13 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-57047f95-3f83-448c-baed-4b36be8505e5" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "cinder-quobyte-57047f95-3f83-448c-baed-4b36be8505e5" released by "delete_volume" :: held 0.699s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Created reservations ['96822e8b-5d26-4877-853f-eb5b36b18c61', '5cc8db9a-2f65-4634-adea-a0f57368fcee', '33139e43-cd97-4570-852b-716d163aaea3', '19af5960-c767-4fb1-8f37-a25f1f823a84'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:13 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:13 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-f83be5f5-43a8-45dc-bc13-6372c559bf9b-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-f83be5f5-43a8-45dc-bc13-6372c559bf9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-f83be5f5-43a8-45dc-bc13-6372c559bf9b" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-f83be5f5-43a8-45dc-bc13-6372c559bf9b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Deleting offline snapshot f83be5f5-43a8-45dc-bc13-6372c559bf9b of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] snapshot_file for this snap is: volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b000a-1539-47e3-9351-86a3cd061afa]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:13 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Deleted volume successfully. Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cf5c015c-7493-4536-9c62-2a6e52eb31de tempest-VolumesMetadataTest-598861000 None] Lock "cinder-57047f95-3f83-448c-baed-4b36be8505e5-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:13 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b Nov 02 12:41:13 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:13 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b20d71-c10e-4576-a1e4-d586be8cb1a3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:14 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:14 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:14 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:14 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b Nov 02 12:41:14 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:14 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:14 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b Nov 02 12:41:14 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:14 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.f83be5f5-43a8-45dc-bc13-6372c559bf9b" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-f83be5f5-43a8-45dc-bc13-6372c559bf9b" released by "_delete_snapshot" :: held 1.609s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" released by "delete_snapshot" :: held 1.637s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Created reservations ['7cabbec6-0a9f-4275-bd67-504e19799219', '4ac2ba8e-8873-406c-892d-e3d7d9dd6e87', '4561042f-1721-48fb-9767-aa9968c1248f', '9047e2c4-9e7f-4fbd-9011-b8566333c012'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Delete snapshot completed successfully. Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-98232c6b-599a-4137-8172-36f56dae2f64 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-f83be5f5-43a8-45dc-bc13-6372c559bf9b-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-34c94b65-ee17-47a3-890c-2d53d7628245-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-34c94b65-ee17-47a3-890c-2d53d7628245-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-34c94b65-ee17-47a3-890c-2d53d7628245" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-34c94b65-ee17-47a3-890c-2d53d7628245" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Deleting offline snapshot 34c94b65-ee17-47a3-890c-2d53d7628245 of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] snapshot_file for this snap is: volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf975d89-6fc3-4857-b49f-62a5bfcd501e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:15 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:15 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:16 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.461s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c436b-3888-4fcc-9973-d199c23f3f2e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:16 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:16 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:16 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.417s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:16 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:16 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:16 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:17 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245 Nov 02 12:41:17 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:17 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.34c94b65-ee17-47a3-890c-2d53d7628245" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-34c94b65-ee17-47a3-890c-2d53d7628245" released by "_delete_snapshot" :: held 1.708s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" released by "delete_snapshot" :: held 1.734s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Created reservations ['f6f889a5-99ea-49c7-bbb6-9580a0d06b29', '8f9a9686-6b5c-4a34-ba17-e50885663377', '24958ffb-f828-4c8d-b3c5-bc10d6b04060', 'c74391aa-4ae0-42f4-afe8-266e49950cef'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Delete snapshot completed successfully. Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9111e19-75f9-4b0c-9c6a-a722eced4937 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-34c94b65-ee17-47a3-890c-2d53d7628245-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Deleting offline snapshot ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 of volume 263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] snapshot_file for this snap is: volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2a347-65af-42a1-b9da-0410a3d50c40]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:18 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb3a7b3-5a9a-4ddb-8fbe-3630226952cd]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba Nov 02 12:41:18 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" returned: 0 in 0.455s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:18 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Flow 'volume_create_manager' (412e90aa-98f6-4f9d-ba92-d4b400d83c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a6b7e7-3528-4eeb-ab60-97075c11a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a6b7e7-3528-4eeb-ab60-97075c11a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-522960606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d2cc40-c349-4790-bc8a-ffedf483a0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2d6ed7633747998ab266e78ce18866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:19Z,use_quota=True,user_id='11c397b48a0d4d7d9419cf90ba658658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c3d03f-c54d-4c30-80c5-0bbcad87b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c3d03f-c54d-4c30-80c5-0bbcad87b83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbad159-6c82-49e5-8c03-642d93176432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbad159-6c82-49e5-8c03-642d93176432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d2cc40-c349-4790-bc8a-ffedf483a0b7', 'volume_name': 'volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a807b75-3d84-4d4e-a31d-32bcee647091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a807b75-3d84-4d4e-a31d-32bcee647091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7369b68-d336-47b9-9206-40acf4fef254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:18 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Volume 42d2cc40-c349-4790-bc8a-ffedf483a0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7', 'volume_size': 1} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-522960606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d2cc40-c349-4790-bc8a-ffedf483a0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2d6ed7633747998ab266e78ce18866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:19Z,use_quota=True,user_id='11c397b48a0d4d7d9419cf90ba658658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Creating volume 42d2cc40-c349-4790-bc8a-ffedf483a0b7 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 1073741824 Nov 02 12:41:18 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:19 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:19 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88 Nov 02 12:41:19 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:19 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 1073741824" returned: 0 in 0.451s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:19 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba.ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88" released by "_delete_snapshot" :: held 1.648s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" released by "delete_snapshot" :: held 1.677s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:19 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 Nov 02 12:41:19 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Created reservations ['61d5e8c8-aa9b-46f4-b227-ee0967247659', '1025ba27-aa07-4388-aad8-3e437d88d4c7', '6825c154-6d3d-4963-b7ff-9ab1d6771852', '4117b675-464e-461e-9e3a-ceaa694bccff'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Delete snapshot completed successfully. Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1a95eb25-5e26-45c5-9d70-3b765f7d0aa7 tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-ffff24b9-39bb-4d3e-bb1d-82c8df97ab88-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:19 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7369b68-d336-47b9-9206-40acf4fef254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e4d2b-a32b-4ef0-a6e1-5ebc8f8eb80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Volume volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 (42d2cc40-c349-4790-bc8a-ffedf483a0b7): created successfully Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e4d2b-a32b-4ef0-a6e1-5ebc8f8eb80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Flow 'volume_create_manager' (412e90aa-98f6-4f9d-ba92-d4b400d83c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bb8c032f-ad37-4acf-ba4a-eb6de29ddbd2 tempest-VolumesTransfersV355Test-1119945936 None] Created volume successfully. Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[58256aca-ae1f-4f8f-8226-a9e9b41dea0a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:20 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba Nov 02 12:41:20 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:20 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:20 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba Nov 02 12:41:20 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (2a3eb61b-2940-4178-a16d-b13730f086a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af1afbe-98f2-46be-ade1-da89f8d6cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af1afbe-98f2-46be-ade1-da89f8d6cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-322162333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b84269f-4f1b-47d6-a033-812f635b2175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:21Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224cecdf-6b1a-446a-a93b-a5fd74cb7d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224cecdf-6b1a-446a-a93b-a5fd74cb7d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403667d2-8ded-437a-a3d9-9e31190468cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403667d2-8ded-437a-a3d9-9e31190468cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b84269f-4f1b-47d6-a033-812f635b2175', 'volume_name': 'volume-8b84269f-4f1b-47d6-a033-812f635b2175', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc63075-085f-4eee-98ef-1a9aa4603988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc63075-085f-4eee-98ef-1a9aa4603988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0705cdf3-406b-4064-b507-a844a1860b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Volume 8b84269f-4f1b-47d6-a033-812f635b2175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b84269f-4f1b-47d6-a033-812f635b2175', 'volume_size': 1} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-322162333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b84269f-4f1b-47d6-a033-812f635b2175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:21Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Creating volume 8b84269f-4f1b-47d6-a033-812f635b2175 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:20 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 1073741824 Nov 02 12:41:20 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:20 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" returned: 0 in 0.262s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-quobyte-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba" released by "delete_volume" :: held 0.733s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Created reservations ['766a2762-0cef-4692-b642-639508e1de09', 'fc40bb04-a709-4011-9975-920f7b12d378', '83352773-2494-4bd5-a596-9396c637e610', '9d0ad627-ec30-42b9-923c-f3a8e3100b5c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:21 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:21 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:21 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 1073741824" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:21 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.303s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Deleted volume successfully. Nov 02 12:41:21 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 Nov 02 12:41:21 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42888ae8-17e6-4d1d-9f7d-a7fdc7aadfbe tempest-VolumesSnapshotListTestJSON-1765377011 None] Lock "cinder-263b7dba-fbc4-45e4-9e64-a93ae2e2bfba-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:21 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0705cdf3-406b-4064-b507-a844a1860b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b84269f-4f1b-47d6-a033-812f635b2175', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72427b7-89dd-424a-a954-f278f48b4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Volume volume-8b84269f-4f1b-47d6-a033-812f635b2175 (8b84269f-4f1b-47d6-a033-812f635b2175): created successfully Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72427b7-89dd-424a-a954-f278f48b4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (2a3eb61b-2940-4178-a16d-b13730f086a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6cdc0e99-ae40-4661-8c50-eabc4a8edd0a tempest-AttachVolumeTestJSON-1043400045 None] Created volume successfully. Nov 02 12:41:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-39fd321d-d022-4aef-901c-a3074d86edc0 tempest-VolumesTransfersV355Test-928012820 None] Transfer volume completed successfully. Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "cinder-42d2cc40-c349-4790-bc8a-ffedf483a0b7-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-42d2cc40-c349-4790-bc8a-ffedf483a0b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "cinder-quobyte-42d2cc40-c349-4790-bc8a-ffedf483a0b7" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-quobyte-42d2cc40-c349-4790-bc8a-ffedf483a0b7" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211dce3-66dd-42d5-b3bc-3e940b371fbf]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:22 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 Nov 02 12:41:22 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:22 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:23 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7 Nov 02 12:41:23 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:23 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-42d2cc40-c349-4790-bc8a-ffedf483a0b7" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-quobyte-42d2cc40-c349-4790-bc8a-ffedf483a0b7" released by "delete_volume" :: held 0.827s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Created reservations ['452c77b2-b46f-4ce8-ba2a-0da055a25ca0', 'f628ff28-1d69-42a8-9e31-f7719ec997e8', '2157aa47-9ad8-4bcf-a6b5-c02f42d0ea66', '9effa6f9-a69e-4d89-ad71-aaef7f5c1c79'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:23 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:23 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-52733cb0-1cc4-44b7-b87b-d3616eaf43ac req-c466ca3c-165e-40f8-ab93-4829bdd3e97e tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-52733cb0-1cc4-44b7-b87b-d3616eaf43ac req-c466ca3c-165e-40f8-ab93-4829bdd3e97e tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-52733cb0-1cc4-44b7-b87b-d3616eaf43ac req-c466ca3c-165e-40f8-ab93-4829bdd3e97e tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-52733cb0-1cc4-44b7-b87b-d3616eaf43ac req-c466ca3c-165e-40f8-ab93-4829bdd3e97e tempest-AttachVolumeTestJSON-1043400045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-8b84269f-4f1b-47d6-a033-812f635b2175', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7136b2f0-5477-4221-80fa-75f796f3af55', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:41:23 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Deleted volume successfully. Nov 02 12:41:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b1481670-5f82-4c06-b954-2d4a6d444497 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-42d2cc40-c349-4790-bc8a-ffedf483a0b7-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-52733cb0-1cc4-44b7-b87b-d3616eaf43ac req-c466ca3c-165e-40f8-ab93-4829bdd3e97e tempest-AttachVolumeTestJSON-1043400045 None] attachment_update completed successfully. Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Flow 'volume_create_manager' (43c31906-80ee-49d5-a612-59ec678fcfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e6393-98d8-4f0c-9740-2b2c9f5806ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e6393-98d8-4f0c-9740-2b2c9f5806ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2143257012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2d6ed7633747998ab266e78ce18866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:24Z,use_quota=True,user_id='11c397b48a0d4d7d9419cf90ba658658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d80ef7f-2509-4507-90b6-e76879e89257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d80ef7f-2509-4507-90b6-e76879e89257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465c2fda-200b-4aed-b483-2aba1a95405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465c2fda-200b-4aed-b483-2aba1a95405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1', 'volume_name': 'volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd44b9f5-b320-471b-9a3b-0115555d4b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd44b9f5-b320-471b-9a3b-0115555d4b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694270e-cbc9-4933-9882-5b8e6296ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Volume 0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1', 'volume_size': 1} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2143257012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2d6ed7633747998ab266e78ce18866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:24Z,use_quota=True,user_id='11c397b48a0d4d7d9419cf90ba658658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Creating volume 0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:24 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 1073741824 Nov 02 12:41:24 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:25 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 1073741824" returned: 0 in 0.600s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:25 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 Nov 02 12:41:25 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:25 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a694270e-cbc9-4933-9882-5b8e6296ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ac2f0e-dba1-4b3c-94cd-85aefb3b2341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Volume volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 (0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1): created successfully Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ac2f0e-dba1-4b3c-94cd-85aefb3b2341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Flow 'volume_create_manager' (43c31906-80ee-49d5-a612-59ec678fcfc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-74cd9d6c-6a4a-4a0c-9f2e-86a09a510282 tempest-VolumesTransfersV355Test-1119945936 None] Created volume successfully. Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (381d5a38-c957-4643-9890-7854d52a9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3228282a-77cb-456c-b3c1-bc70feb2eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3228282a-77cb-456c-b3c1-bc70feb2eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1385596042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a688517a-f570-4b2f-845c-3a9b0355ba17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:27Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518f0420-89aa-41a9-9018-0721540cda07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518f0420-89aa-41a9-9018-0721540cda07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfd8538-d8a3-4641-ad27-a8f5b9833bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfd8538-d8a3-4641-ad27-a8f5b9833bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a688517a-f570-4b2f-845c-3a9b0355ba17', 'volume_name': 'volume-a688517a-f570-4b2f-845c-3a9b0355ba17', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410bee43-34e1-4ac3-9e2a-7f50f5405179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410bee43-34e1-4ac3-9e2a-7f50f5405179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba06a1cf-d2ac-4859-8d2a-65daf0b7227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Volume a688517a-f570-4b2f-845c-3a9b0355ba17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a688517a-f570-4b2f-845c-3a9b0355ba17', 'volume_size': 1} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1385596042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a688517a-f570-4b2f-845c-3a9b0355ba17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603a15a90c19455b8daa165807faa19d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:27Z,use_quota=True,user_id='fa1e5aea3e354e1a91815c41f1b6f38c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Creating volume a688517a-f570-4b2f-845c-3a9b0355ba17 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:26 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:26 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 1073741824 Nov 02 12:41:26 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "cinder-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "cinder-quobyte-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-quobyte-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec45028e-b5da-4a31-9392-2041e027e3f1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:27 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 Nov 02 12:41:27 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:27 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 1073741824" returned: 0 in 0.628s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:27 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 Nov 02 12:41:27 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:27 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" returned: 0 in 0.638s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:27 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1 Nov 02 12:41:27 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-6fc8e243-dcb8-4cbf-aaa4-e12f57672175 tempest-ServerActionsTestOtherA-646512174 None] Terminate volume connection completed successfully. Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-6fc8e243-dcb8-4cbf-aaa4-e12f57672175 tempest-ServerActionsTestOtherA-646512174 None] Deleting attachment 90439aa8-12bc-4f64-b33d-38d3604fd1c4. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:41:27 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba06a1cf-d2ac-4859-8d2a-65daf0b7227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a688517a-f570-4b2f-845c-3a9b0355ba17', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dcf0056-38b9-4087-a15e-2b7854c3a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Volume volume-a688517a-f570-4b2f-845c-3a9b0355ba17 (a688517a-f570-4b2f-845c-3a9b0355ba17): created successfully Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dcf0056-38b9-4087-a15e-2b7854c3a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Flow 'volume_create_manager' (381d5a38-c957-4643-9890-7854d52a9307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "cinder-5f36cee4-bca2-446e-9d58-5d564c07601d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eb362773-b7d0-40c2-84cd-8e7c4efbfac3 tempest-AttachVolumeTestJSON-1043400045 None] Created volume successfully. Nov 02 12:41:28 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-5f36cee4-bca2-446e-9d58-5d564c07601d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-quobyte-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1" released by "delete_volume" :: held 1.079s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "cinder-quobyte-5f36cee4-bca2-446e-9d58-5d564c07601d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-quobyte-5f36cee4-bca2-446e-9d58-5d564c07601d" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9ff4e-b963-4a29-9421-b2574523ad37]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Created reservations ['a7af61d1-8ed8-4bf4-acd9-1f0585adbc80', '2f939d82-123f-4146-8ecb-32a68921b718', '7c9d53a5-6ede-4f64-abb6-fa9f50c57c40', '6050cc9f-5b9b-4dc7-a114-4d09c4f2a43c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:28 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d Nov 02 12:41:28 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:28 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:28 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:28 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Deleted volume successfully. Nov 02 12:41:28 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-36a8d35a-5dd5-4739-b352-96dde6ccc268 tempest-VolumesTransfersV355Test-1185914346 None] Lock "cinder-0bdaa6fb-2bab-46fe-a354-8c0cdc1412f1-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:28 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d Nov 02 12:41:28 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:29 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:29 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "cinder-5de513b0-6143-4611-9ea9-7826234f24a0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-5de513b0-6143-4611-9ea9-7826234f24a0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "cinder-quobyte-5de513b0-6143-4611-9ea9-7826234f24a0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-quobyte-5de513b0-6143-4611-9ea9-7826234f24a0" acquired by "delete_volume" :: waited 0.040s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f57ea2-ada5-4b3c-8e27-4916b7589c1b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:29 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f36cee4-bca2-446e-9d58-5d564c07601d" returned: 0 in 0.509s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-quobyte-5f36cee4-bca2-446e-9d58-5d564c07601d" released by "delete_volume" :: held 1.089s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:29 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.533s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.quota [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Created reservations ['873ef292-ee24-41a3-b331-21905b5085bf', 'ebee8272-df1a-48f8-913a-9015cc98f053', '5b0b94f1-1559-477b-b161-931672c11f32', 'de78bab3-92a8-48ab-83ed-6b8e7ef8ccf9'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:29 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 Nov 02 12:41:29 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:29 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:29 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:30 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:30 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0" returned: 0 in 0.827s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.manager [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Deleted volume successfully. Nov 02 12:41:30 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0 Nov 02 12:41:30 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-b90966b7-451b-4f3c-8bac-9335c756a62b req-a6e15cd6-69a6-4ac1-9f1a-482829557488 tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-5f36cee4-bca2-446e-9d58-5d564c07601d-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a1a5add5-538f-4d46-89ef-7904dbd7df21 req-4c76b377-1edf-4385-8aed-17a38996b400 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a1a5add5-538f-4d46-89ef-7904dbd7df21 req-4c76b377-1edf-4385-8aed-17a38996b400 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a1a5add5-538f-4d46-89ef-7904dbd7df21 req-4c76b377-1edf-4385-8aed-17a38996b400 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a1a5add5-538f-4d46-89ef-7904dbd7df21 req-4c76b377-1edf-4385-8aed-17a38996b400 tempest-AttachVolumeTestJSON-1043400045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-a688517a-f570-4b2f-845c-3a9b0355ba17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4588551d-7085-4396-8ade-195bfe21bbf2', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:41:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-a1a5add5-538f-4d46-89ef-7904dbd7df21 req-4c76b377-1edf-4385-8aed-17a38996b400 tempest-AttachVolumeTestJSON-1043400045 None] attachment_update completed successfully. Nov 02 12:41:30 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5de513b0-6143-4611-9ea9-7826234f24a0" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-quobyte-5de513b0-6143-4611-9ea9-7826234f24a0" released by "delete_volume" :: held 1.275s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Created reservations ['459b51b8-cc39-42e5-966d-eb0bbf75c6cf', '48c27cff-b4fb-4c1b-b0b0-6af7cd634885', 'aaaad9fa-9cf6-49f6-a19e-9ff14cc475f6', '7540eb78-590a-4516-b56c-bf2d9fc16295'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:30 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:30 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:31 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Deleted volume successfully. Nov 02 12:41:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-39a564d9-7d01-458c-8bc2-75673cd5ccbc tempest-ServerActionsTestOtherA-646512174 None] Lock "cinder-5de513b0-6143-4611-9ea9-7826234f24a0-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-1b64de71-be3f-4d1d-90ff-75f5c8a23bff req-b6057d71-15e3-487d-9b64-72e5e8faa8f3 tempest-AttachVolumeTestJSON-1043400045 None] Terminate volume connection completed successfully. Nov 02 12:41:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-1b64de71-be3f-4d1d-90ff-75f5c8a23bff req-b6057d71-15e3-487d-9b64-72e5e8faa8f3 tempest-AttachVolumeTestJSON-1043400045 None] Deleting attachment 7136b2f0-5477-4221-80fa-75f796f3af55. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:41:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-bd50f674-1bed-4621-83fc-9f6dd1f80635 req-0a58dbed-242e-4cc4-83f7-8cdc2cec2da7 tempest-AttachVolumeTestJSON-1043400045 None] Terminate volume connection completed successfully. Nov 02 12:41:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-bd50f674-1bed-4621-83fc-9f6dd1f80635 req-0a58dbed-242e-4cc4-83f7-8cdc2cec2da7 tempest-AttachVolumeTestJSON-1043400045 None] Deleting attachment 4588551d-7085-4396-8ade-195bfe21bbf2. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=112,cinder:INSERT=36,cinder:UPDATE=137,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Flow 'volume_create_manager' (752964b4-b2c6-481d-ac1c-31cffb297572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9258f3af-f8f8-4319-aa2e-573af19528f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9258f3af-f8f8-4319-aa2e-573af19528f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1192731497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2f5156-3fca-4d0f-987b-df222c650c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0fbfd3dc4674835984cf3997f3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:44Z,use_quota=True,user_id='5ab26fc346f9494893b57799ac450d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cd0608-1f0b-45e1-aa97-d31b9e9529e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cd0608-1f0b-45e1-aa97-d31b9e9529e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f0fa30-00d4-4cf9-a3a5-c06e5ac7b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f0fa30-00d4-4cf9-a3a5-c06e5ac7b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2f5156-3fca-4d0f-987b-df222c650c79', 'volume_name': 'volume-6c2f5156-3fca-4d0f-987b-df222c650c79', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc62244-afad-4913-aea7-66b2c43d76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc62244-afad-4913-aea7-66b2c43d76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a4ec56-e1fd-4b67-b5d7-d3087f3d4518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Volume 6c2f5156-3fca-4d0f-987b-df222c650c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2f5156-3fca-4d0f-987b-df222c650c79', 'volume_size': 2} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1192731497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2f5156-3fca-4d0f-987b-df222c650c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaa0fbfd3dc4674835984cf3997f3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:44Z,use_quota=True,user_id='5ab26fc346f9494893b57799ac450d34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Creating volume 6c2f5156-3fca-4d0f-987b-df222c650c79 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 2147483648 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:43 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 2147483648 Nov 02 12:41:43 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:44 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 2147483648" returned: 0 in 0.795s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:44 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 Nov 02 12:41:44 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:45 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a4ec56-e1fd-4b67-b5d7-d3087f3d4518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2f5156-3fca-4d0f-987b-df222c650c79', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680d25a9-1109-452c-b2ff-3b65cc8a44ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Volume volume-6c2f5156-3fca-4d0f-987b-df222c650c79 (6c2f5156-3fca-4d0f-987b-df222c650c79): created successfully Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680d25a9-1109-452c-b2ff-3b65cc8a44ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Flow 'volume_create_manager' (752964b4-b2c6-481d-ac1c-31cffb297572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1fbba86a-e5da-4a31-ab26-1cf69b9fba4a tempest-VolumesCloneNegativeTest-1257555334 None] Created volume successfully. Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-a688517a-f570-4b2f-845c-3a9b0355ba17-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-a688517a-f570-4b2f-845c-3a9b0355ba17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-quobyte-a688517a-f570-4b2f-845c-3a9b0355ba17" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-a688517a-f570-4b2f-845c-3a9b0355ba17" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6677b25e-335d-4f08-9f82-d3c7ebd3b495]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:45 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 Nov 02 12:41:45 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:45 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:45 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17 Nov 02 12:41:45 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Acquiring lock "cinder-6c2f5156-3fca-4d0f-987b-df222c650c79-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "cinder-6c2f5156-3fca-4d0f-987b-df222c650c79-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:46 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a688517a-f570-4b2f-845c-3a9b0355ba17" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-a688517a-f570-4b2f-845c-3a9b0355ba17" released by "delete_volume" :: held 0.840s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Acquiring lock "cinder-quobyte-6c2f5156-3fca-4d0f-987b-df222c650c79" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "cinder-quobyte-6c2f5156-3fca-4d0f-987b-df222c650c79" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cf8f27-578b-47d6-832f-f59234d11921]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Created reservations ['8234022e-8bf3-409b-9e72-f4b2e5f79252', '97a57ce7-44ed-4d59-a3d4-1f107bae2a42', '8a47bfea-36e0-4371-817f-e3b48f021f92', 'b5be829c-fec4-4ad0-ac5f-b48fb41a6663'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:46 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 Nov 02 12:41:46 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:46 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:46 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-8b84269f-4f1b-47d6-a033-812f635b2175-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-8b84269f-4f1b-47d6-a033-812f635b2175-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=170,cinder:DELETE=16,cinder:SELECT=127,cinder:INSERT=38 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-quobyte-8b84269f-4f1b-47d6-a033-812f635b2175" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-8b84269f-4f1b-47d6-a033-812f635b2175" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eac4e7-fb40-435f-8076-060cf1227d28]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:46 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Deleted volume successfully. Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad282edb-8d54-401d-96fa-b0326d0c686d tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-a688517a-f570-4b2f-845c-3a9b0355ba17-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:47 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:47 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 Nov 02 12:41:47 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79" returned: 0 in 0.759s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:47 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79 Nov 02 12:41:47 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:47 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6c2f5156-3fca-4d0f-987b-df222c650c79" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "cinder-quobyte-6c2f5156-3fca-4d0f-987b-df222c650c79" released by "delete_volume" :: held 1.251s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:47 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175" returned: 0 in 0.802s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:47 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175 Nov 02 12:41:47 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Created reservations ['507a9aae-abf2-4289-9f05-f020e1144aca', '03d42a61-3165-4a62-837b-73dcf4b31cfb', '4fedb2c2-29f3-4254-b627-3d6eb3f04387', '244ba6eb-6725-4fd2-a1dd-ee1faa042f56'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:47 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:47 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:47 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8b84269f-4f1b-47d6-a033-812f635b2175" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-8b84269f-4f1b-47d6-a033-812f635b2175" released by "delete_volume" :: held 1.290s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Created reservations ['c341900e-1845-4e77-8857-151169aa1a83', '5855fff2-57dc-4506-bed9-781c2614c4ed', '8143469a-c410-40d8-87c4-1b1d6867fb4b', 'fae9b8a9-7a9b-4b2d-9f7e-dc28f1b33bd9'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:48 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:48 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:48 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.549s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Deleted volume successfully. Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb39a221-68c1-44d5-b7a3-78de96b09491 tempest-VolumesCloneNegativeTest-1257555334 None] Lock "cinder-6c2f5156-3fca-4d0f-987b-df222c650c79-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:48 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Deleted volume successfully. Nov 02 12:41:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c4d552da-b879-496e-a3a3-ff5dcb242d99 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-8b84269f-4f1b-47d6-a033-812f635b2175-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-b862ebd6-1ff7-4630-a51b-9222f981e515-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-b862ebd6-1ff7-4630-a51b-9222f981e515-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "cinder-quobyte-b862ebd6-1ff7-4630-a51b-9222f981e515" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-b862ebd6-1ff7-4630-a51b-9222f981e515" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee97b947-aed7-4fa6-b7cf-855ff639261b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:49 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 Nov 02 12:41:49 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:49 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515" returned: 0 in 0.488s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:49 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515 Nov 02 12:41:49 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:50 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b862ebd6-1ff7-4630-a51b-9222f981e515" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-quobyte-b862ebd6-1ff7-4630-a51b-9222f981e515" released by "delete_volume" :: held 0.883s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Created reservations ['89ae868f-e0d5-4a77-a35a-19d0568e0953', 'e528b1b6-5470-43bc-a6b1-4fc4e6851ded', 'f3cb6a3b-340f-415d-a9da-f1f33ad3de76', '0ee0c54c-2ed8-47ec-8aa4-4dd21fa1bba6'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:50 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:41:50 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:50 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Deleted volume successfully. Nov 02 12:41:50 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4b740667-f06f-4456-b115-4c131d7eae77 tempest-AttachVolumeTestJSON-1043400045 None] Lock "cinder-b862ebd6-1ff7-4630-a51b-9222f981e515-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Flow 'volume_create_manager' (cdec96a1-82ca-4502-a926-e3f079c7cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0033a2c5-ad73-405d-a54b-5749db42309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0033a2c5-ad73-405d-a54b-5749db42309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1334404441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47441ff2-9ff4-47e6-9755-30bd4adae9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daecb231dac24209aabccedede04dcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:55Z,use_quota=True,user_id='d6cf888ceb9144b6a32d85bf9b0f64c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e922564-54bb-4d83-a5b2-1a5777b1cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e922564-54bb-4d83-a5b2-1a5777b1cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca67f5aa-e3fb-43a2-b46b-e12cb5b4c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca67f5aa-e3fb-43a2-b46b-e12cb5b4c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47441ff2-9ff4-47e6-9755-30bd4adae9e2', 'volume_name': 'volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c20d249-a938-4ac6-b2e0-6af08ca9d785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c20d249-a938-4ac6-b2e0-6af08ca9d785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b601d505-75bf-43b0-838d-38aa963789fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Trying to clone 47441ff2-9ff4-47e6-9755-30bd4adae9e2 from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:41:55 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:41:55 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b2fa86-ad59-4cae-b7bb-b5b0963713f7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:56 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD Nov 02 12:41:56 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:56 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b is fetched for user d6cf888ceb9144b6a32d85bf9b0f64c2. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68136d-7391-4cf6-8a8e-d1baa22de913]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:56 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD Nov 02 12:41:56 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (f24ba0be-e3f4-47ac-a184-cf1c392e593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ebdd9d-b5d1-4202-bc3d-e9c8ad3cdc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ebdd9d-b5d1-4202-bc3d-e9c8ad3cdc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1005107231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a742099d-6a41-4853-878b-c599da3a83b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:57Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b2cd713-918b-418c-998f-c920069f5d58),volume_type_id=1b2cd713-918b-418c-998f-c920069f5d58)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0e81b6-3387-4406-af0e-63129c45ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0e81b6-3387-4406-af0e-63129c45ee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3678b0a-b45e-4420-8ced-7ae7c14d75f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3678b0a-b45e-4420-8ced-7ae7c14d75f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a742099d-6a41-4853-878b-c599da3a83b2', 'volume_name': 'volume-a742099d-6a41-4853-878b-c599da3a83b2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3135d-bda2-4a51-89d8-b8ad3370a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a3135d-bda2-4a51-89d8-b8ad3370a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb461947-7c9b-446f-a69a-e9b3bb703d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Volume a742099d-6a41-4853-878b-c599da3a83b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a742099d-6a41-4853-878b-c599da3a83b2', 'volume_size': 1} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1005107231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a742099d-6a41-4853-878b-c599da3a83b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:57Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b2cd713-918b-418c-998f-c920069f5d58),volume_type_id=1b2cd713-918b-418c-998f-c920069f5d58)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Creating volume a742099d-6a41-4853-878b-c599da3a83b2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:57 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 1073741824 Nov 02 12:41:57 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:57 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (fc0c2090-e8c7-461a-86bf-ebd8e338db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac628fc-478d-40ab-8649-1baaf8db04d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac628fc-478d-40ab-8649-1baaf8db04d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1356415066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31e8401-17f1-453f-9d6d-f6266fd7b58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:58Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef60b198-4390-4ad4-9353-ec9a3e4b75be),volume_type_id=ef60b198-4390-4ad4-9353-ec9a3e4b75be)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45298192-20cc-460a-b472-aadeca9022fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45298192-20cc-460a-b472-aadeca9022fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17dda1f-b67d-422f-a6a6-6a955c2b4cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17dda1f-b67d-422f-a6a6-6a955c2b4cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31e8401-17f1-453f-9d6d-f6266fd7b58a', 'volume_name': 'volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823c8f5d-4b78-4efc-823e-ffa481fe5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823c8f5d-4b78-4efc-823e-ffa481fe5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025eed95-dd2a-4f73-83e8-664704bed229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Volume b31e8401-17f1-453f-9d6d-f6266fd7b58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a', 'volume_size': 1} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:58 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 1073741824" returned: 0 in 0.948s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:58 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 Nov 02 12:41:58 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:58 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1334404441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47441ff2-9ff4-47e6-9755-30bd4adae9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daecb231dac24209aabccedede04dcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:55Z,use_quota=True,user_id='d6cf888ceb9144b6a32d85bf9b0f64c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Creating volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb461947-7c9b-446f-a69a-e9b3bb703d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a742099d-6a41-4853-878b-c599da3a83b2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:58 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1073741824 Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a6c41f-eb7f-44df-982c-1d90c026cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:58 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Volume volume-a742099d-6a41-4853-878b-c599da3a83b2 (a742099d-6a41-4853-878b-c599da3a83b2): created successfully Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a6c41f-eb7f-44df-982c-1d90c026cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (f24ba0be-e3f4-47ac-a184-cf1c392e593e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ebcfa07d-b987-44de-a092-62746a8666da tempest-TestInstancesWithCinderVolumes-819478937 None] Created volume successfully. Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (2a493617-ab5e-43ab-b89a-2ea32bd2c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b202b29-3b8b-4feb-b02d-6bd67ddd7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b202b29-3b8b-4feb-b02d-6bd67ddd7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-445955789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7871351c-6294-4c52-903e-8eb5527b6cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:59Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80de94c1-e261-4a7a-979d-8111640df4cb),volume_type_id=80de94c1-e261-4a7a-979d-8111640df4cb)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da32f4d-1adf-4f08-8890-b6451aca793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8da32f4d-1adf-4f08-8890-b6451aca793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e95d7a-852d-4465-ac47-f53cf6659162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:58 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:41:59 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1073741824" returned: 0 in 0.704s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:59 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 Nov 02 12:41:59 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e95d7a-852d-4465-ac47-f53cf6659162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7871351c-6294-4c52-903e-8eb5527b6cf7', 'volume_name': 'volume-7871351c-6294-4c52-903e-8eb5527b6cf7', 'volume_size': 1, 'image_id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1161137412', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8daa83ee77f14c0c88c7dfabd02cb7d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'created_at': datetime.datetime(2026, 11, 2, 11, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 41, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436b465f-cc36-405f-867f-f4bb51b30e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436b465f-cc36-405f-867f-f4bb51b30e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438a8c9d-9fce-45d6-8337-ba5022f49fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Volume 7871351c-6294-4c52-903e-8eb5527b6cf7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7871351c-6294-4c52-903e-8eb5527b6cf7', 'volume_size': 1, 'image_id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1161137412', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8daa83ee77f14c0c88c7dfabd02cb7d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'created_at': datetime.datetime(2026, 11, 2, 11, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 41, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5/file', 'properties': {}}, 'image_service': } Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Trying to clone 7871351c-6294-4c52-903e-8eb5527b6cf7 from image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:41:59 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1356415066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31e8401-17f1-453f-9d6d-f6266fd7b58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:58Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef60b198-4390-4ad4-9353-ec9a3e4b75be),volume_type_id=ef60b198-4390-4ad4-9353-ec9a3e4b75be)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Creating volume b31e8401-17f1-453f-9d6d-f6266fd7b58a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:59 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a 1073741824 Nov 02 12:41:59 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Attempting download of 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ad5cc-ae04-4fca-8df4-1875ef4943b2]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:00 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n Nov 02 12:42:00 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:00 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a 1073741824" returned: 0 in 0.785s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:00 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n" returned: 0 in 0.647s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:00 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a Nov 02 12:42:00 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:00 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n Nov 02 12:42:00 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:00 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025eed95-dd2a-4f73-83e8-664704bed229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6dc601-9982-4c62-9938-41e7ffee0625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Volume volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a (b31e8401-17f1-453f-9d6d-f6266fd7b58a): created successfully Nov 02 12:42:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6dc601-9982-4c62-9938-41e7ffee0625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (fc0c2090-e8c7-461a-86bf-ebd8e338db56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c591911a-34f5-4d28-aa21-57efcadd001a tempest-TestInstancesWithCinderVolumes-819478937 None] Created volume successfully. Nov 02 12:42:01 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n" returned: 1 in 0.643s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_blctau9n' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[16906bdf-7ea7-48a8-a90e-0be89898e620]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:01 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD Nov 02 12:42:01 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:01 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:42:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:01 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 Nov 02 12:42:01 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD, size 20.69 MB, duration 4.99 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:42:04 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Image download 20.69 MB at 4.15 MB/s Nov 02 12:42:04 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2" returned: 0 in 2.783s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_r27at4rpdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:42:04 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Converted 112.00 MB image at 40.22 MB/s Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:04 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1G Nov 02 12:42:04 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3100b-70aa-429a-8a48-3e746507d02b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:04 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD Nov 02 12:42:04 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:05 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 1G" returned: 0 in 0.475s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Downloaded image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b for user d6cf888ceb9144b6a32d85bf9b0f64c2 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Marking volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:42:05 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Temporary image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 is fetched for user 3195c8d216b94ad889da559796af0923. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Copying metadata from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b to 47441ff2-9ff4-47e6-9755-30bd4adae9e2. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Creating volume glance metadata for volume 47441ff2-9ff4-47e6-9755-30bd4adae9e2 backed by image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d997d56-f956-476a-a222-a4cec396dce8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b601d505-75bf-43b0-838d-38aa963789fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb567c7-7c56-4c59-8ad2-22584f127bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:05 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD Nov 02 12:42:05 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Volume volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 (47441ff2-9ff4-47e6-9755-30bd4adae9e2): created successfully Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb567c7-7c56-4c59-8ad2-22584f127bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Flow 'volume_create_manager' (cdec96a1-82ca-4502-a926-e3f079c7cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-13305b08-265a-40e0-905a-e786168a06f3 tempest-VolumesExtendTest-2017080231 None] Created volume successfully. Nov 02 12:42:05 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-445955789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7871351c-6294-4c52-903e-8eb5527b6cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8daa83ee77f14c0c88c7dfabd02cb7d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:59Z,use_quota=True,user_id='3195c8d216b94ad889da559796af0923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80de94c1-e261-4a7a-979d-8111640df4cb),volume_type_id=80de94c1-e261-4a7a-979d-8111640df4cb)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Creating volume 7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:42:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:42:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:05 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1073741824 Nov 02 12:42:05 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:06 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1073741824" returned: 0 in 0.661s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:06 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 Nov 02 12:42:06 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:06 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.389s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdd63b-81fb-4a8b-b794-caaa31a29fba]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Attempting download of 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}])) to volume 7871351c-6294-4c52-903e-8eb5527b6cf7. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eaccdb-8531-4d34-95ae-e0f8bab12a38]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:06 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 Nov 02 12:42:06 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:06 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw Nov 02 12:42:06 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:07 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:07 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 2G" returned: 0 in 0.133s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.610s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:07 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw Nov 02 12:42:07 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-da52143b-0085-4fad-a761-b9f7e7e06a61 tempest-VolumesExtendTest-2017080231 None] Extend volume completed successfully. Nov 02 12:42:07 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw" returned: 1 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_6i3omlxw' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacaebf-5dcc-4567-a55a-77f14b51e0be]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:07 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD Nov 02 12:42:07 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:07 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:42:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:07 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 Nov 02 12:42:07 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-47441ff2-9ff4-47e6-9755-30bd4adae9e2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-47441ff2-9ff4-47e6-9755-30bd4adae9e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-quobyte-47441ff2-9ff4-47e6-9755-30bd4adae9e2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-47441ff2-9ff4-47e6-9755-30bd4adae9e2" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[99814d27-5f55-4408-bab3-bea9f251ebfe]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:09 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 Nov 02 12:42:09 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:09 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:09 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2 Nov 02 12:42:09 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:10 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47441ff2-9ff4-47e6-9755-30bd4adae9e2" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-47441ff2-9ff4-47e6-9755-30bd4adae9e2" released by "delete_volume" :: held 0.948s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Created reservations ['ebd09bab-3d32-4617-b0d1-4104e6e3452e', '71f5198c-759b-4eff-887d-5f7d5da5eadd', '549a270b-567d-4269-a845-04cf21d4d0a0', '4a230eed-bf21-4f4d-978c-f4d1373d8cff'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:10 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:42:10 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:10 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7" returned: 0 in 2.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7bcdbb35-e283-4ca9-9828-8ad7a241a1b5_o87qdm4cdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:42:10 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Converted 112.00 MB image at 44.46 MB/s Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:10 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:42:10 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1G Nov 02 12:42:10 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Deleted volume successfully. Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5483669b-1fa4-4972-a399-7e3e130c9187 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-47441ff2-9ff4-47e6-9755-30bd4adae9e2-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:10 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 1G" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Downloaded image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}])) to volume 7871351c-6294-4c52-903e-8eb5527b6cf7 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Temporary image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 for user 3195c8d216b94ad889da559796af0923 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Marking volume 7871351c-6294-4c52-903e-8eb5527b6cf7 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Copying metadata from image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 to 7871351c-6294-4c52-903e-8eb5527b6cf7. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:42:10 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Creating volume glance metadata for volume 7871351c-6294-4c52-903e-8eb5527b6cf7 backed by image 7bcdbb35-e283-4ca9-9828-8ad7a241a1b5 with: {'image_id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'image_name': 'tempest-scenario-img--1161137412', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438a8c9d-9fce-45d6-8337-ba5022f49fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7871351c-6294-4c52-903e-8eb5527b6cf7', 'volume_size': 1, 'image_id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1161137412', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8daa83ee77f14c0c88c7dfabd02cb7d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bcdbb35-e283-4ca9-9828-8ad7a241a1b5', 'created_at': datetime.datetime(2026, 11, 2, 11, 41, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 41, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bcdbb35-e283-4ca9-9828-8ad7a241a1b5/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e4f0af-5f43-453f-9528-f019819fba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Volume volume-7871351c-6294-4c52-903e-8eb5527b6cf7 (7871351c-6294-4c52-903e-8eb5527b6cf7): created successfully Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e4f0af-5f43-453f-9528-f019819fba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Flow 'volume_create_manager' (2a493617-ab5e-43ab-b89a-2ea32bd2c09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8a2b329e-faa3-4b94-84eb-593306520a91 tempest-TestInstancesWithCinderVolumes-819478937 None] Created volume successfully. Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Flow 'volume_create_manager' (a8f6c251-c1b1-420b-bf9b-8e3e89d910dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6468746e-1c2f-4eec-a9ba-ad7008a0a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6468746e-1c2f-4eec-a9ba-ad7008a0a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1558216477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0f118c-2618-4f0b-a988-93ade89e3ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daecb231dac24209aabccedede04dcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:12Z,use_quota=True,user_id='d6cf888ceb9144b6a32d85bf9b0f64c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765884b-c697-48c8-83d3-9cc333f2b7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0765884b-c697-48c8-83d3-9cc333f2b7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15004f58-10c7-4b90-ae70-26a6178bb905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15004f58-10c7-4b90-ae70-26a6178bb905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0f118c-2618-4f0b-a988-93ade89e3ad9', 'volume_name': 'volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7382a446-192e-4f8a-9aba-d0154fceabeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7382a446-192e-4f8a-9aba-d0154fceabeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f339a0-43a7-4e61-bc32-fd75b573f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Volume 5c0f118c-2618-4f0b-a988-93ade89e3ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9', 'volume_size': 1} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1558216477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0f118c-2618-4f0b-a988-93ade89e3ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daecb231dac24209aabccedede04dcd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:12Z,use_quota=True,user_id='d6cf888ceb9144b6a32d85bf9b0f64c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Creating volume 5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:42:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:42:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:11 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 1073741824 Nov 02 12:42:11 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:12 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 1073741824" returned: 0 in 0.756s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:12 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:12 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:13 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f339a0-43a7-4e61-bc32-fd75b573f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aab7e7-a1f8-42f9-bb9e-102ed3d0401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Volume volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 (5c0f118c-2618-4f0b-a988-93ade89e3ad9): created successfully Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aab7e7-a1f8-42f9-bb9e-102ed3d0401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Flow 'volume_create_manager' (a8f6c251-c1b1-420b-bf9b-8e3e89d910dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5c637bf6-26f3-4ddb-9ffa-53ec6007f7b7 tempest-VolumesExtendTest-2017080231 None] Created volume successfully. Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Creating offline snapshot a86bc988-4e16-462b-8526-f563e4dbba26 of volume 5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4682a-d5d1-44e1-931f-9e2ca8834d30]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:14 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:14 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:14 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:14 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 1G Nov 02 12:42:14 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:15 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 1G" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:15 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 Nov 02 12:42:15 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:15 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 is being set with open permissions: ugo+rw Nov 02 12:42:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:15 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 Nov 02 12:42:15 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:16 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26" returned: 0 in 0.701s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:16 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info Nov 02 12:42:16 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:16 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info" returned: 0 in 0.499s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:16 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info is being set with open permissions: ugo+rw Nov 02 12:42:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:17 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info Nov 02 12:42:17 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:17 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.info" returned: 0 in 0.625s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-68411a61-8a2e-4ce5-8b72-5581d30f24a2 tempest-VolumesExtendTest-2017080231 None] Create snapshot completed successfully Nov 02 12:42:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c17158-d527-4466-a96d-7f70a064964d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:19 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:19 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-7d1b70e1-891a-4843-892f-5609d4c54d5b req-58ea01cd-a6f6-4ef8-96d6-670d4e3c7bde tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:20 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 1.062s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 2G" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.491s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-7d1b70e1-891a-4843-892f-5609d4c54d5b req-58ea01cd-a6f6-4ef8-96d6-670d4e3c7bde tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.918s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-7d1b70e1-891a-4843-892f-5609d4c54d5b req-58ea01cd-a6f6-4ef8-96d6-670d4e3c7bde tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-7d1b70e1-891a-4843-892f-5609d4c54d5b req-58ea01cd-a6f6-4ef8-96d6-670d4e3c7bde tempest-TestInstancesWithCinderVolumes-819478937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-7871351c-6294-4c52-903e-8eb5527b6cf7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd542d977-3ba4-4555-a488-18677a862de5', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:42:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5bd97c97-6621-44e5-9469-2354c9578ad5 tempest-VolumesExtendTest-2017080231 None] Extend volume completed successfully. Nov 02 12:42:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-7d1b70e1-891a-4843-892f-5609d4c54d5b req-58ea01cd-a6f6-4ef8-96d6-670d4e3c7bde tempest-TestInstancesWithCinderVolumes-819478937 None] attachment_update completed successfully. Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-a86bc988-4e16-462b-8526-f563e4dbba26-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-a86bc988-4e16-462b-8526-f563e4dbba26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-quobyte-a86bc988-4e16-462b-8526-f563e4dbba26" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-a86bc988-4e16-462b-8526-f563e4dbba26" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Deleting offline snapshot a86bc988-4e16-462b-8526-f563e4dbba26 of volume 5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] snapshot_file for this snap is: volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087f04b-8ece-41d6-b75b-fd74c4bbd8ae]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:22 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 Nov 02 12:42:22 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:22 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26" returned: 0 in 0.502s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0193dc0-288c-44aa-8c57-0ee423de4d1b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:22 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:22 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:23 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 0.478s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:23 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 Nov 02 12:42:23 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:23 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26" returned: 0 in 0.629s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:23 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26 Nov 02 12:42:23 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:24 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9.a86bc988-4e16-462b-8526-f563e4dbba26" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-a86bc988-4e16-462b-8526-f563e4dbba26" released by "_delete_snapshot" :: held 2.232s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" released by "delete_snapshot" :: held 2.279s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Created reservations ['84eed37f-f25a-437a-bb4d-b096a759bb2b', '2ffaba73-0b85-46ee-bb55-c092cbbaed32', '2a21f7fe-01f0-4e68-a61f-96c635a0f99a', '8991db77-b8ce-417e-a977-451349d0cb53'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:42:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Delete snapshot completed successfully. Nov 02 12:42:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f1b30a6a-c31d-42a4-89eb-a76155c3b721 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-a86bc988-4e16-462b-8526-f563e4dbba26-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-5c0f118c-2618-4f0b-a988-93ade89e3ad9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-5c0f118c-2618-4f0b-a988-93ade89e3ad9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[238be587-84f9-46f9-bd00-4423788bb32f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:26 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:26 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:26 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 0.917s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:26 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9 Nov 02 12:42:26 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:27 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5c0f118c-2618-4f0b-a988-93ade89e3ad9" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-quobyte-5c0f118c-2618-4f0b-a988-93ade89e3ad9" released by "delete_volume" :: held 1.359s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Created reservations ['dd11ba49-e16b-44ab-ab7f-642e67fee3fe', 'f5cdc784-5481-42ed-bfc2-088da4b47554', 'c67b5b8e-ea24-44ee-8dcd-1a8e6ce32b9e', '294abf1b-e59d-4183-be9b-336c122447b5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:27 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:42:27 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:27 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:42:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Deleted volume successfully. Nov 02 12:42:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e331a6e-0617-4f0f-8091-a25564097157 tempest-VolumesExtendTest-2017080231 None] Lock "cinder-5c0f118c-2618-4f0b-a988-93ade89e3ad9-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:29 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:42:29 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:29 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.687s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:42:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:42:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:42:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Flow 'volume_create_manager' (2b6b884f-2414-42c1-af01-fb5c26b9f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f033ae96-e3d6-4fd3-b9c3-232e98dba865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f033ae96-e3d6-4fd3-b9c3-232e98dba865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-209207230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e7fdf-9d41-4590-908d-0a6c31871574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1d49bb11f436fb1849cbc1e9546c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:35Z,use_quota=True,user_id='e107f467a7754a299dcba305ad969b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07b67d-30f6-4252-9475-6ba666404c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b07b67d-30f6-4252-9475-6ba666404c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece3f1f9-b62b-4949-b7c9-fed23e1c4b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece3f1f9-b62b-4949-b7c9-fed23e1c4b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13e7fdf-9d41-4590-908d-0a6c31871574', 'volume_name': 'volume-a13e7fdf-9d41-4590-908d-0a6c31871574', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1fc8e3-e51f-40ff-bc3a-215bc77a92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1fc8e3-e51f-40ff-bc3a-215bc77a92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c6c409-9ede-4936-83b5-2e6702ff96fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Volume a13e7fdf-9d41-4590-908d-0a6c31871574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13e7fdf-9d41-4590-908d-0a6c31871574', 'volume_size': 1} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-209207230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e7fdf-9d41-4590-908d-0a6c31871574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc1d49bb11f436fb1849cbc1e9546c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:35Z,use_quota=True,user_id='e107f467a7754a299dcba305ad969b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Creating volume a13e7fdf-9d41-4590-908d-0a6c31871574 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:42:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:42:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:35 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 1073741824 Nov 02 12:42:35 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:36 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 1073741824" returned: 0 in 0.741s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:36 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 Nov 02 12:42:36 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:36 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c6c409-9ede-4936-83b5-2e6702ff96fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13e7fdf-9d41-4590-908d-0a6c31871574', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081241bd-fc52-4fb8-9bb0-9db995819dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Volume volume-a13e7fdf-9d41-4590-908d-0a6c31871574 (a13e7fdf-9d41-4590-908d-0a6c31871574): created successfully Nov 02 12:42:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081241bd-fc52-4fb8-9bb0-9db995819dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Flow 'volume_create_manager' (2b6b884f-2414-42c1-af01-fb5c26b9f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d6ac7190-907b-4dc4-9f29-5523ed602763 tempest-VolumesNegativeTest-1036661930 None] Created volume successfully. Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=79,cinder:UPDATE=71,cinder:INSERT=25,cinder:DELETE=4 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Flow 'volume_create_manager' (3bed03d9-8cee-4566-a808-4c5c35079d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5cfbef-a1bb-4c3e-8be8-40daa227eaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5cfbef-a1bb-4c3e-8be8-40daa227eaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1812812086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012386ec-79e8-41e2-9306-4f66edf6dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56d0b4b592144eaa37c8f58301ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:44Z,use_quota=True,user_id='b9e4ce28f552473790143a99a3092fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b5b770-05bb-45d0-8841-e2c6b1e98309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b5b770-05bb-45d0-8841-e2c6b1e98309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40213bf-dc23-449b-8466-57164073cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40213bf-dc23-449b-8466-57164073cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012386ec-79e8-41e2-9306-4f66edf6dbf4', 'volume_name': 'volume-012386ec-79e8-41e2-9306-4f66edf6dbf4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe46c87c-2185-4dee-9f06-ebb00348878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe46c87c-2185-4dee-9f06-ebb00348878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef557ae-0073-4c3b-b066-04f3837d282c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Volume 012386ec-79e8-41e2-9306-4f66edf6dbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012386ec-79e8-41e2-9306-4f66edf6dbf4', 'volume_size': 1} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1812812086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012386ec-79e8-41e2-9306-4f66edf6dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56d0b4b592144eaa37c8f58301ec676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:44Z,use_quota=True,user_id='b9e4ce28f552473790143a99a3092fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Creating volume 012386ec-79e8-41e2-9306-4f66edf6dbf4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:42:44 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:42:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:44 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 1073741824 Nov 02 12:42:44 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:45 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 1073741824" returned: 0 in 1.108s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:45 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 Nov 02 12:42:45 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:45 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:42:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef557ae-0073-4c3b-b066-04f3837d282c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012386ec-79e8-41e2-9306-4f66edf6dbf4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7b19f3-3fc7-4adc-b921-871c34ce7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Volume volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 (012386ec-79e8-41e2-9306-4f66edf6dbf4): created successfully Nov 02 12:42:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7b19f3-3fc7-4adc-b921-871c34ce7f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Flow 'volume_create_manager' (3bed03d9-8cee-4566-a808-4c5c35079d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-83d43faa-4dbd-4b35-9402-138297dca22c tempest-AttachVolumeShelveTestJSON-651935097 None] Created volume successfully. Nov 02 12:42:56 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=67,cinder:INSERT=30,cinder:UPDATE=86,cinder:DELETE=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:56 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-73af3522-65d8-4363-9f42-1d3127159e38 req-e20aa952-3eee-430c-9be0-fe2879e9deb0 tempest-AttachVolumeShelveTestJSON-651935097 None] No connector for attachment c882fd8a-4a15-4fbe-9197-db22fcad234f; skipping storage backend terminate_connection call. {{(pid=86731) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 12:42:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-73af3522-65d8-4363-9f42-1d3127159e38 req-e20aa952-3eee-430c-9be0-fe2879e9deb0 tempest-AttachVolumeShelveTestJSON-651935097 None] Deleting attachment c882fd8a-4a15-4fbe-9197-db22fcad234f. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:43:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5865eb7a-99ab-41a6-bfe4-ed90e473d542 req-9f847e1d-c481-4749-9b83-69d3876b6053 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5865eb7a-99ab-41a6-bfe4-ed90e473d542 req-9f847e1d-c481-4749-9b83-69d3876b6053 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-5865eb7a-99ab-41a6-bfe4-ed90e473d542 req-9f847e1d-c481-4749-9b83-69d3876b6053 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-5865eb7a-99ab-41a6-bfe4-ed90e473d542 req-9f847e1d-c481-4749-9b83-69d3876b6053 tempest-TestInstancesWithCinderVolumes-819478937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-a742099d-6a41-4853-878b-c599da3a83b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f7891d1-48fc-440c-a381-f4a33352deab', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:43:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-5865eb7a-99ab-41a6-bfe4-ed90e473d542 req-9f847e1d-c481-4749-9b83-69d3876b6053 tempest-TestInstancesWithCinderVolumes-819478937 None] attachment_update completed successfully. Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Acquiring lock "cinder-a13e7fdf-9d41-4590-908d-0a6c31871574-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "cinder-a13e7fdf-9d41-4590-908d-0a6c31871574-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Acquiring lock "cinder-quobyte-a13e7fdf-9d41-4590-908d-0a6c31871574" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "cinder-quobyte-a13e7fdf-9d41-4590-908d-0a6c31871574" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84529ac6-e66f-4474-badc-9db8733d2d65]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:05 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 Nov 02 12:43:05 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:06 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:06 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574 Nov 02 12:43:06 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:06 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a13e7fdf-9d41-4590-908d-0a6c31871574" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "cinder-quobyte-a13e7fdf-9d41-4590-908d-0a6c31871574" released by "delete_volume" :: held 0.797s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Created reservations ['ba63e833-2810-4133-99b0-327a66ce4a5d', 'fa2d13d8-5aba-45f7-92a0-38efd96c2a30', '74557e22-d429-4721-9263-d6a365e1bb48', '9022fdf5-c2c9-4f99-a99f-ce81aa4f7d79'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:06 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:06 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:07 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.366s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Deleted volume successfully. Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a0bbb275-9167-4e77-9206-aee67ba48218 tempest-VolumesNegativeTest-1036661930 None] Lock "cinder-a13e7fdf-9d41-4590-908d-0a6c31871574-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c8486303-63da-4d87-8d31-31f153b88446 req-73435b6f-e4a3-4cfd-b13d-65bef842cdb5 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c8486303-63da-4d87-8d31-31f153b88446 req-73435b6f-e4a3-4cfd-b13d-65bef842cdb5 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c8486303-63da-4d87-8d31-31f153b88446 req-73435b6f-e4a3-4cfd-b13d-65bef842cdb5 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-c8486303-63da-4d87-8d31-31f153b88446 req-73435b6f-e4a3-4cfd-b13d-65bef842cdb5 tempest-TestInstancesWithCinderVolumes-819478937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c0a0df6-ba54-42d9-8bed-11cf06f5c075', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:43:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-c8486303-63da-4d87-8d31-31f153b88446 req-73435b6f-e4a3-4cfd-b13d-65bef842cdb5 tempest-TestInstancesWithCinderVolumes-819478937 None] attachment_update completed successfully. Nov 02 12:43:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (bae670bb-1a0f-4947-9ae5-d380192b2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ffbfa-21a4-4638-80d3-cb73907df00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ffbfa-21a4-4638-80d3-cb73907df00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-603725185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:08Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e808b92f-cb92-4b1e-a298-af76d6d7f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e808b92f-cb92-4b1e-a298-af76d6d7f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba7137-fc81-4fe1-b2c3-016c45d3b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba7137-fc81-4fe1-b2c3-016c45d3b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2', 'volume_name': 'volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc98c3e-2621-43e8-a542-994b9e5a0af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc98c3e-2621-43e8-a542-994b9e5a0af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c722ddc-6886-4673-9dbc-2fbb256693d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Volume 9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2', 'volume_size': 1} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-603725185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:08Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Creating volume 9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:43:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:08 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 1073741824 Nov 02 12:43:08 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:08 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 1073741824" returned: 0 in 0.654s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:08 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 Nov 02 12:43:08 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:09 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c722ddc-6886-4673-9dbc-2fbb256693d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90390c17-bdef-451e-8ea3-b6de6e5456cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Volume volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 (9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2): created successfully Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90390c17-bdef-451e-8ea3-b6de6e5456cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (bae670bb-1a0f-4947-9ae5-d380192b2314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a9d729b2-a428-4f2e-b857-75b10ed4cca5 tempest-AttachVolumeNegativeTest-766111125 None] Created volume successfully. Nov 02 12:43:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d7dfbda9-d8a4-4951-acde-e1886494cf4c req-e801f9bd-2a74-432c-b8bd-734d429087ea tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d7dfbda9-d8a4-4951-acde-e1886494cf4c req-e801f9bd-2a74-432c-b8bd-734d429087ea tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d7dfbda9-d8a4-4951-acde-e1886494cf4c req-e801f9bd-2a74-432c-b8bd-734d429087ea tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d7dfbda9-d8a4-4951-acde-e1886494cf4c req-e801f9bd-2a74-432c-b8bd-734d429087ea tempest-AttachVolumeNegativeTest-766111125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d7dfe0e-2a34-4de7-9c4e-43d7c1e40aaf', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:43:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d7dfbda9-d8a4-4951-acde-e1886494cf4c req-e801f9bd-2a74-432c-b8bd-734d429087ea tempest-AttachVolumeNegativeTest-766111125 None] attachment_update completed successfully. Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Flow 'volume_create_manager' (66d0b7c6-e541-442c-b0fe-886fcaac4e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98f50a4-fff7-469a-bd33-7b06ed61438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98f50a4-fff7-469a-bd33-7b06ed61438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2000378366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de2288-8f9d-4a0f-a81c-99c47f32e674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e809bfc61546a6b89ee1e44313df7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:13Z,use_quota=True,user_id='2661c3f0d0584be399944f5bfdab7148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672b7881-2511-4a91-9faa-b3bf592f8950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672b7881-2511-4a91-9faa-b3bf592f8950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a58659-f183-4595-b11b-450015e9d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a58659-f183-4595-b11b-450015e9d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88de2288-8f9d-4a0f-a81c-99c47f32e674', 'volume_name': 'volume-88de2288-8f9d-4a0f-a81c-99c47f32e674', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2aa042-f79b-4b75-af7b-8220a2758039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2aa042-f79b-4b75-af7b-8220a2758039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6191c085-7775-47e6-92b8-7c78496512b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Volume 88de2288-8f9d-4a0f-a81c-99c47f32e674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88de2288-8f9d-4a0f-a81c-99c47f32e674', 'volume_size': 2} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2000378366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de2288-8f9d-4a0f-a81c-99c47f32e674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e809bfc61546a6b89ee1e44313df7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:13Z,use_quota=True,user_id='2661c3f0d0584be399944f5bfdab7148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Creating volume 88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:43:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 2147483648 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:13 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 2147483648 Nov 02 12:43:13 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:13 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 2147483648" returned: 0 in 0.808s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:14 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 Nov 02 12:43:14 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:14 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6191c085-7775-47e6-92b8-7c78496512b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88de2288-8f9d-4a0f-a81c-99c47f32e674', 'volume_size': 2}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c55d13-7f68-4c58-8eec-d06f5850f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Volume volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 (88de2288-8f9d-4a0f-a81c-99c47f32e674): created successfully Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c55d13-7f68-4c58-8eec-d06f5850f217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Flow 'volume_create_manager' (66d0b7c6-e541-442c-b0fe-886fcaac4e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f09661f6-1668-4047-98c6-a37ad2d09fb6 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Created volume successfully. Nov 02 12:43:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-522cdc80-18ff-40c0-bb8e-00ab6d99b4b6 req-3f6ba8f2-3692-4b3a-b22d-c079c4b1fd0a tempest-TestInstancesWithCinderVolumes-819478937 None] Terminate volume connection completed successfully. Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-522cdc80-18ff-40c0-bb8e-00ab6d99b4b6 req-3f6ba8f2-3692-4b3a-b22d-c079c4b1fd0a tempest-TestInstancesWithCinderVolumes-819478937 None] Deleting attachment 8f7891d1-48fc-440c-a381-f4a33352deab. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Creating offline snapshot a3336a7c-57d6-4e91-b41c-a49439d4e886 of volume 88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd4db32-4ebf-49ca-9791-0bb233cd0bc1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:15 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 Nov 02 12:43:15 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-a742099d-6a41-4853-878b-c599da3a83b2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:15 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 2G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-a742099d-6a41-4853-878b-c599da3a83b2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:15 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 2G Nov 02 12:43:15 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-quobyte-a742099d-6a41-4853-878b-c599da3a83b2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-a742099d-6a41-4853-878b-c599da3a83b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbfd598-6cae-4fbf-996d-48958747e6a9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:16 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 Nov 02 12:43:16 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:16 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 2G" returned: 0 in 0.692s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:16 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 Nov 02 12:43:16 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:16 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2" returned: 0 in 0.602s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:16 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2 Nov 02 12:43:16 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:17 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a742099d-6a41-4853-878b-c599da3a83b2" returned: 0 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-a742099d-6a41-4853-878b-c599da3a83b2" released by "delete_volume" :: held 1.091s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:17 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-828203471-714173143 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-828203471-714173143, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:17 devstack cinder-volume[86731]: WARNING cinder.quota [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-828203471-714173143 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-828203471-714173143, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886" returned: 0 in 0.593s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:17 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 is being set with open permissions: ugo+rw Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:17 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 Nov 02 12:43:17 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Created reservations ['d1b592a2-6428-42ff-9c59-e830f656044d', 'bdb08ab2-6f5e-400d-bc9c-aa90f72bd2d3', '72707705-7ef8-4cad-b425-9f5b829a1cb8', 'bfb5f1b9-b357-40e2-8f1c-3df7a7ef7fa8'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:17 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:17 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:17 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:17 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info Nov 02 12:43:17 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:18 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.619s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Deleted volume successfully. Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-871d3d56-78da-4bfc-b238-15ec03eef2cb tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-a742099d-6a41-4853-878b-c599da3a83b2-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:18 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:18 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info is being set with open permissions: ugo+rw Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:18 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info Nov 02 12:43:18 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:18 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.info" returned: 0 in 0.302s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.135s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ac1e982c-50f1-416d-9417-4f1c51831416 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Create snapshot completed successfully Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "cinder-a3336a7c-57d6-4e91-b41c-a49439d4e886-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-a3336a7c-57d6-4e91-b41c-a49439d4e886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "cinder-quobyte-a3336a7c-57d6-4e91-b41c-a49439d4e886" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-a3336a7c-57d6-4e91-b41c-a49439d4e886" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Deleting offline snapshot a3336a7c-57d6-4e91-b41c-a49439d4e886 of volume 88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] snapshot_file for this snap is: volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7da42-3175-4d7b-bb42-590c5f24335a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:20 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 Nov 02 12:43:20 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:20 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886" returned: 0 in 0.565s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88de2288-8f9d-4a0f-a81c-99c47f32e674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5788a5-70f2-423c-bf16-9846405b3b89]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:20 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 Nov 02 12:43:20 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:21 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-8c3a40af-b19c-48ae-bfb3-ffd526432235 req-17fa6b91-21d2-4266-ae64-8f695eed4eab tempest-TestInstancesWithCinderVolumes-819478937 None] Terminate volume connection completed successfully. Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-8c3a40af-b19c-48ae-bfb3-ffd526432235 req-17fa6b91-21d2-4266-ae64-8f695eed4eab tempest-TestInstancesWithCinderVolumes-819478937 None] Deleting attachment 5c0a0df6-ba54-42d9-8bed-11cf06f5c075. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674" returned: 0 in 0.643s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:21 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 Nov 02 12:43:21 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:21 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:21 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886 Nov 02 12:43:21 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-b31e8401-17f1-453f-9d6d-f6266fd7b58a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-b31e8401-17f1-453f-9d6d-f6266fd7b58a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-quobyte-b31e8401-17f1-453f-9d6d-f6266fd7b58a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-b31e8401-17f1-453f-9d6d-f6266fd7b58a" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c9d97-6ab0-4129-bf88-4711faabc68b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:22 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674.a3336a7c-57d6-4e91-b41c-a49439d4e886" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:22 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-a3336a7c-57d6-4e91-b41c-a49439d4e886" released by "_delete_snapshot" :: held 2.365s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:22 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" released by "delete_snapshot" :: held 2.410s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Created reservations ['6380178c-e3b3-414d-92b3-9b194bfac549', '52e0c933-6f40-4222-b057-4b859f4fff9f', '588e7148-8b6c-4760-b704-f7a52cb383d3', '1f914280-abf9-472a-a765-e259201c25f5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Delete snapshot completed successfully. Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5642860a-5dd9-45cd-b4bb-d9228fe23e30 tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-a3336a7c-57d6-4e91-b41c-a49439d4e886-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:22 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a" returned: 0 in 0.618s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:22 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a Nov 02 12:43:22 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:23 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b31e8401-17f1-453f-9d6d-f6266fd7b58a" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-b31e8401-17f1-453f-9d6d-f6266fd7b58a" released by "delete_volume" :: held 1.168s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "cinder-88de2288-8f9d-4a0f-a81c-99c47f32e674-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-88de2288-8f9d-4a0f-a81c-99c47f32e674-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:23 devstack cinder-volume[86731]: WARNING cinder.quota [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805892213-428974291 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805892213-428974291, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:23 devstack cinder-volume[86731]: WARNING cinder.quota [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805892213-428974291 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1805892213-428974291, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Created reservations ['390dbf7d-2d9d-47b4-939c-9916f7d94ad2', '544b5801-ba83-48c7-97cb-67b92cacbe05', 'edb006e1-2f74-4ffa-bbcd-08d137d755ca', 'b3ecd120-7042-44c4-9395-a7952190d1d6'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa1655f-d2c7-47bd-8dd4-c6478517c539]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:23 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:23 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:23 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 Nov 02 12:43:23 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:24 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Deleted volume successfully. Nov 02 12:43:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1e7995b8-0222-409d-9cf3-e687ad9cd13e tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-b31e8401-17f1-453f-9d6d-f6266fd7b58a-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:24 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674" returned: 0 in 0.698s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:24 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674 Nov 02 12:43:24 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:25 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-88de2288-8f9d-4a0f-a81c-99c47f32e674" returned: 0 in 0.742s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-quobyte-88de2288-8f9d-4a0f-a81c-99c47f32e674" released by "delete_volume" :: held 1.595s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Created reservations ['c84cab07-4e7e-462e-8386-9c5cacf589d8', '33d7b5f9-dffb-4ceb-b815-92513a8e448b', 'ac31c1e3-1845-4f6d-8b2b-101e137300df', '8c872b6c-ced7-42b8-b842-8c217b52d421'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:25 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:25 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:25 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Deleted volume successfully. Nov 02 12:43:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-84e334aa-2cf0-4911-9585-41a4f31ccb0e tempest-VolumesSnapshotNegativeTestJSON-1424450852 None] Lock "cinder-88de2288-8f9d-4a0f-a81c-99c47f32e674-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-449800bf-8201-4e49-9ce7-cf68ff3a62ed req-ffda50ee-3f08-4241-8613-4c9b40d2ef4d tempest-TestInstancesWithCinderVolumes-819478937 None] Terminate volume connection completed successfully. Nov 02 12:43:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-449800bf-8201-4e49-9ce7-cf68ff3a62ed req-ffda50ee-3f08-4241-8613-4c9b40d2ef4d tempest-TestInstancesWithCinderVolumes-819478937 None] Deleting attachment d542d977-3ba4-4555-a488-18677a862de5. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:43:29 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:29 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:29 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:43:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:43:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-7871351c-6294-4c52-903e-8eb5527b6cf7-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-7871351c-6294-4c52-903e-8eb5527b6cf7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "cinder-quobyte-7871351c-6294-4c52-903e-8eb5527b6cf7" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-7871351c-6294-4c52-903e-8eb5527b6cf7" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[01be465d-bd80-4d51-a2d9-8e7daef35518]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:30 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 Nov 02 12:43:30 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:30 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:30 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7 Nov 02 12:43:30 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:31 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7871351c-6294-4c52-903e-8eb5527b6cf7" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-quobyte-7871351c-6294-4c52-903e-8eb5527b6cf7" released by "delete_volume" :: held 0.966s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:31 devstack cinder-volume[86731]: WARNING cinder.quota [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1609001350-688170924 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1609001350-688170924, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:31 devstack cinder-volume[86731]: WARNING cinder.quota [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1609001350-688170924 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1609001350-688170924, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Created reservations ['45a999ff-829a-47e2-9b23-7af8ea4fb82c', '3291fdb0-bbe2-4102-a3bb-69f33fba2bdc', '7c779bbf-8c6f-44b1-ad84-c6aa90abc7dc', 'd66fd54e-75e2-4a9b-a771-7c8aa56e9eb0'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:31 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:31 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:31 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Deleted volume successfully. Nov 02 12:43:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-342f3d8a-4ee2-467f-9dde-314fb713f451 tempest-TestInstancesWithCinderVolumes-819478937 None] Lock "cinder-7871351c-6294-4c52-903e-8eb5527b6cf7-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:41 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=67,cinder:UPDATE=63,cinder:INSERT=16,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:43:41 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=56,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Acquiring lock "cinder-012386ec-79e8-41e2-9306-4f66edf6dbf4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "cinder-012386ec-79e8-41e2-9306-4f66edf6dbf4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Acquiring lock "cinder-quobyte-012386ec-79e8-41e2-9306-4f66edf6dbf4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "cinder-quobyte-012386ec-79e8-41e2-9306-4f66edf6dbf4" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f48e8-15e6-4b8a-b344-9da31c8ad8d4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:45 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 Nov 02 12:43:45 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:46 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:46 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4 Nov 02 12:43:46 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:46 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-012386ec-79e8-41e2-9306-4f66edf6dbf4" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "cinder-quobyte-012386ec-79e8-41e2-9306-4f66edf6dbf4" released by "delete_volume" :: held 0.843s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Created reservations ['fddd7794-7ed9-4ad5-b184-2a3f26736fc4', '1a164f4c-0340-43ff-aead-f8c782ab6121', '63f24f80-af7c-44c5-a0d2-851887229c43', '07824a52-18cb-490e-85e6-7231f6dd8208'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:46 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:43:46 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:47 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Deleted volume successfully. Nov 02 12:43:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d219a520-5ee9-469d-b12b-b79a8c21dcfb tempest-AttachVolumeShelveTestJSON-651935097 None] Lock "cinder-012386ec-79e8-41e2-9306-4f66edf6dbf4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-256a7647-ebb0-423e-a23b-76f9e147486d req-5071e881-d8d6-4df6-9156-85d47774dc35 tempest-AttachVolumeNegativeTest-766111125 None] Terminate volume connection completed successfully. Nov 02 12:44:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-256a7647-ebb0-423e-a23b-76f9e147486d req-5071e881-d8d6-4df6-9156-85d47774dc35 tempest-AttachVolumeNegativeTest-766111125 None] Deleting attachment 4d7dfe0e-2a34-4de7-9c4e-43d7c1e40aaf. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:44:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Flow 'volume_create_manager' (4c1edf0d-4c2c-4864-b4a1-18344d790a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a08eb63-e14f-4e0d-9eb2-06d047f20f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a08eb63-e14f-4e0d-9eb2-06d047f20f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-842521574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c41f20-53cd-4ab8-98e0-a07e821cea4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05e5894d0f4547a4a5261768445b3b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:02Z,use_quota=True,user_id='da67659e31224704a198a03f3828c77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a94010-82c1-4d7f-8182-0d87d0759d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a94010-82c1-4d7f-8182-0d87d0759d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8232b28e-f5f9-405d-87c7-60e0780a131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8232b28e-f5f9-405d-87c7-60e0780a131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c41f20-53cd-4ab8-98e0-a07e821cea4c', 'volume_name': 'volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db903d8-c3aa-4092-a962-f4d9ad811125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db903d8-c3aa-4092-a962-f4d9ad811125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2973b97-1666-4f5a-be19-fce86a0c529e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Volume e6c41f20-53cd-4ab8-98e0-a07e821cea4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c', 'volume_size': 1} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-842521574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c41f20-53cd-4ab8-98e0-a07e821cea4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05e5894d0f4547a4a5261768445b3b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:02Z,use_quota=True,user_id='da67659e31224704a198a03f3828c77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Creating volume e6c41f20-53cd-4ab8-98e0-a07e821cea4c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:44:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:02 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c 1073741824 Nov 02 12:44:02 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:03 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c 1073741824" returned: 0 in 0.798s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:03 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c Nov 02 12:44:03 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Flow 'volume_create_manager' (d74411f8-7c98-4664-9a4d-a721a8b27534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f174ce-90c8-4be9-a04c-01a50fe523ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f174ce-90c8-4be9-a04c-01a50fe523ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-601505167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3c8406-17fe-4f3e-993e-83647dfea958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb40b28c3f405fb0b52608177ab022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:03Z,use_quota=True,user_id='e536a194b72f41b4ad8864619226f5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540c324d-abe1-4c04-8906-240b6c009366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540c324d-abe1-4c04-8906-240b6c009366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946866ec-576f-4f92-ad97-ba5194c7418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946866ec-576f-4f92-ad97-ba5194c7418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3c8406-17fe-4f3e-993e-83647dfea958', 'volume_name': 'volume-fb3c8406-17fe-4f3e-993e-83647dfea958', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7103c5-f764-4833-951b-645e829aa4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c7103c5-f764-4833-951b-645e829aa4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c7e04b-c142-49f1-a6cc-3873eda0a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Volume fb3c8406-17fe-4f3e-993e-83647dfea958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3c8406-17fe-4f3e-993e-83647dfea958', 'volume_size': 1} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:03 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-601505167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3c8406-17fe-4f3e-993e-83647dfea958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb40b28c3f405fb0b52608177ab022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:03Z,use_quota=True,user_id='e536a194b72f41b4ad8864619226f5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Creating volume fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2973b97-1666-4f5a-be19-fce86a0c529e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bca070-6174-4618-905b-c105333fc75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:03 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 1073741824 Nov 02 12:44:03 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Volume volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c (e6c41f20-53cd-4ab8-98e0-a07e821cea4c): created successfully Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bca070-6174-4618-905b-c105333fc75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Flow 'volume_create_manager' (4c1edf0d-4c2c-4864-b4a1-18344d790a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-a7471db2-f1d8-477a-bec5-9c2bef9caf73 req-2bab4299-d312-4cc2-bbb9-a3d1da970e6c tempest-VolumesGetTestJSON-1797759410 None] Created volume successfully. Nov 02 12:44:04 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 1073741824" returned: 0 in 0.665s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:04 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:44:04 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:04 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c7e04b-c142-49f1-a6cc-3873eda0a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3c8406-17fe-4f3e-993e-83647dfea958', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9756f6f4-97f4-493f-87ce-d1b33ada5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Volume volume-fb3c8406-17fe-4f3e-993e-83647dfea958 (fb3c8406-17fe-4f3e-993e-83647dfea958): created successfully Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9756f6f4-97f4-493f-87ce-d1b33ada5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Flow 'volume_create_manager' (d74411f8-7c98-4664-9a4d-a721a8b27534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1b9bfa0f-c039-4593-ad85-9f501bd715d2 tempest-TestStampPattern-1463458724 None] Created volume successfully. Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Acquiring lock "cinder-e6c41f20-53cd-4ab8-98e0-a07e821cea4c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "cinder-e6c41f20-53cd-4ab8-98e0-a07e821cea4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Acquiring lock "cinder-quobyte-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "cinder-quobyte-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179a50a-9f51-4f01-8880-62a4f95cf30b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:05 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c Nov 02 12:44:05 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:05 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" returned: 0 in 0.594s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:05 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c Nov 02 12:44:05 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:06 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "cinder-quobyte-e6c41f20-53cd-4ab8-98e0-a07e821cea4c" released by "delete_volume" :: held 1.142s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.quota [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Created reservations ['ab2cb82d-0460-4a7e-ba36-304c512ca550', 'de95015f-daed-4ffa-acc6-e9b250ef0df9', '3cc406a7-1e3e-4367-9f35-df9386683f40', '7a84119e-5bc7-458b-a376-5577525ff826'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:06 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:44:06 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:06 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.manager [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:44:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Deleted volume successfully. Nov 02 12:44:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-0d07d3be-9c20-4f5b-947c-3f9b6bda8b4d req-5f13f22a-617e-44bf-8482-ae36036a8934 tempest-VolumesGetTestJSON-1797759410 None] Lock "cinder-e6c41f20-53cd-4ab8-98e0-a07e821cea4c-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:16 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=21,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:16 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=16,cinder:DELETE=2,cinder:SELECT=6,cinder:INSERT=5 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:29 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:44:29 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:29 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.552s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:44:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:44:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:44:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:44:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-70c5d1c7-7d64-4573-9661-1a5f2c38b36e req-4822de1c-38aa-4a57-a91c-48f5621c1981 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-70c5d1c7-7d64-4573-9661-1a5f2c38b36e req-4822de1c-38aa-4a57-a91c-48f5621c1981 tempest-TestStampPattern-1463458724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-70c5d1c7-7d64-4573-9661-1a5f2c38b36e req-4822de1c-38aa-4a57-a91c-48f5621c1981 tempest-TestStampPattern-1463458724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-70c5d1c7-7d64-4573-9661-1a5f2c38b36e req-4822de1c-38aa-4a57-a91c-48f5621c1981 tempest-TestStampPattern-1463458724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-fb3c8406-17fe-4f3e-993e-83647dfea958', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd26d41e4-8a73-44ea-8275-28a531ad0026', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:44:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-70c5d1c7-7d64-4573-9661-1a5f2c38b36e req-4822de1c-38aa-4a57-a91c-48f5621c1981 tempest-TestStampPattern-1463458724 None] attachment_update completed successfully. Nov 02 12:44:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-94492022-fc5d-4825-9a1c-98b4af906597 req-206abdc7-649b-42e2-890b-568476f62b6a tempest-TestStampPattern-1463458724 None] Terminate volume connection completed successfully. Nov 02 12:44:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-94492022-fc5d-4825-9a1c-98b4af906597 req-206abdc7-649b-42e2-890b-568476f62b6a tempest-TestStampPattern-1463458724 None] Deleting attachment d26d41e4-8a73-44ea-8275-28a531ad0026. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:44:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Creating offline snapshot e32a939d-dc6c-42ad-be03-1349bc71209e of volume fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:44:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d5ffd3-49de-4585-9335-ea1a00dd2ac5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:47 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:44:47 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:47 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.637s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:47 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e 1G Nov 02 12:44:47 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:48 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e 1G" returned: 0 in 0.635s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3c8406-17fe-4f3e-993e-83647dfea958 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:48 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3c8406-17fe-4f3e-993e-83647dfea958 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:44:48 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:48 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3c8406-17fe-4f3e-993e-83647dfea958 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:48 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e is being set with open permissions: ugo+rw Nov 02 12:44:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:48 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:44:48 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:49 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:49 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info Nov 02 12:44:49 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:49 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:49 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info is being set with open permissions: ugo+rw Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:49 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info Nov 02 12:44:49 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Flow 'volume_create_manager' (74687cbf-5db3-41a0-9b06-b33eccef68fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5980e0ce-92e4-42ac-b2a5-420a3f625b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:49 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.info" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5980e0ce-92e4-42ac-b2a5-420a3f625b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1611970916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899125cf69bd474fb112479c74bea33b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:50Z,use_quota=True,user_id='3074b80d2c5942b5968d0659f5d8d8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670b909e-3891-4bfb-90a0-7c9f20622f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670b909e-3891-4bfb-90a0-7c9f20622f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f49be-4fb8-4ee3-8700-c944bd592f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f49be-4fb8-4ee3-8700-c944bd592f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3', 'volume_name': 'volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce06107f-819d-492b-bcba-2be882d72ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce06107f-819d-492b-bcba-2be882d72ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab2d8fe-38c0-4eb7-aeb8-bb9d45ffd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Volume dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3', 'volume_size': 1} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1611970916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899125cf69bd474fb112479c74bea33b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:50Z,use_quota=True,user_id='3074b80d2c5942b5968d0659f5d8d8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Creating volume dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:50 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 1073741824 Nov 02 12:44:50 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-aaaf1662-0693-4d91-88c7-db99d7c8f2a7 tempest-TestStampPattern-1463458724 None] Create snapshot completed successfully Nov 02 12:44:50 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 1073741824" returned: 0 in 0.804s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:50 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 Nov 02 12:44:50 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:51 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab2d8fe-38c0-4eb7-aeb8-bb9d45ffd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4562c82-7a9e-48b0-8e86-8973924b9f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Volume volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 (dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3): created successfully Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4562c82-7a9e-48b0-8e86-8973924b9f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Flow 'volume_create_manager' (74687cbf-5db3-41a0-9b06-b33eccef68fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-de33a982-4110-4fad-86e4-56bca0e3f088 tempest-TestMinimumBasicScenario-913775510 None] Created volume successfully. Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-f79c525d-963b-4f30-8564-7f4b887bbf70 req-6e896f62-f056-4aab-b375-aaf445ef4e75 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-f79c525d-963b-4f30-8564-7f4b887bbf70 req-6e896f62-f056-4aab-b375-aaf445ef4e75 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-f79c525d-963b-4f30-8564-7f4b887bbf70 req-6e896f62-f056-4aab-b375-aaf445ef4e75 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-f79c525d-963b-4f30-8564-7f4b887bbf70 req-6e896f62-f056-4aab-b375-aaf445ef4e75 tempest-TestMinimumBasicScenario-913775510 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a2ab781-bf76-489e-b737-b927791a5123', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:44:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-f79c525d-963b-4f30-8564-7f4b887bbf70 req-6e896f62-f056-4aab-b375-aaf445ef4e75 tempest-TestMinimumBasicScenario-913775510 None] attachment_update completed successfully. Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Flow 'volume_create_manager' (63157016-16f2-47a9-ab49-8a0fc47eba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473fc580-1b99-46bb-aac6-b821136ab897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473fc580-1b99-46bb-aac6-b821136ab897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1910221232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01292bee-f2cd-4bac-92a9-98031228192e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5672eb366c4a4d0daa3b4f4642b52651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='2bb62bbf95c7451a9d1271852918cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3e089e-f65b-47b0-80cc-222dc5d70b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3e089e-f65b-47b0-80cc-222dc5d70b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4839f20d-ee61-4d41-860c-48c94437ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4839f20d-ee61-4d41-860c-48c94437ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01292bee-f2cd-4bac-92a9-98031228192e', 'volume_name': 'volume-01292bee-f2cd-4bac-92a9-98031228192e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f1b4e5-b435-4375-b7f1-52ea9913785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f1b4e5-b435-4375-b7f1-52ea9913785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0ba317-8b00-42fb-bbfa-03e4085ff6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Volume 01292bee-f2cd-4bac-92a9-98031228192e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01292bee-f2cd-4bac-92a9-98031228192e', 'volume_size': 1} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1910221232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01292bee-f2cd-4bac-92a9-98031228192e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5672eb366c4a4d0daa3b4f4642b52651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='2bb62bbf95c7451a9d1271852918cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Creating volume 01292bee-f2cd-4bac-92a9-98031228192e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:44:54 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e 1073741824 Nov 02 12:44:54 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (8f7ac9f3-184d-4268-a332-45b85cc0baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc819d12-d851-409f-b332-d8e34b177965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc819d12-d851-409f-b332-d8e34b177965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-143378667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d740c3c6-b91c-4cc5-987d-a6af99a2a25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d37e889-a837-402c-8c94-e49c569876ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d37e889-a837-402c-8c94-e49c569876ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7d6b9a-0335-4295-a117-9a5235eb2f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7d6b9a-0335-4295-a117-9a5235eb2f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd740c3c6-b91c-4cc5-987d-a6af99a2a25a', 'volume_name': 'volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca067a78-fec5-47c8-982e-c2c02f70c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca067a78-fec5-47c8-982e-c2c02f70c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e58113-1173-4806-9011-b805e3997e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Volume d740c3c6-b91c-4cc5-987d-a6af99a2a25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a', 'volume_size': 1} Nov 02 12:44:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:55 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e 1073741824" returned: 0 in 0.662s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:55 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e Nov 02 12:44:55 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:55 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.934s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-143378667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d740c3c6-b91c-4cc5-987d-a6af99a2a25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Creating volume d740c3c6-b91c-4cc5-987d-a6af99a2a25a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:55 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a 1073741824 Nov 02 12:44:55 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0ba317-8b00-42fb-bbfa-03e4085ff6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01292bee-f2cd-4bac-92a9-98031228192e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5122a-3f85-49ff-ad18-253dc13f9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Volume volume-01292bee-f2cd-4bac-92a9-98031228192e (01292bee-f2cd-4bac-92a9-98031228192e): created successfully Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a5122a-3f85-49ff-ad18-253dc13f9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Flow 'volume_create_manager' (63157016-16f2-47a9-ab49-8a0fc47eba29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4c3a033d-30a3-463c-841e-6079bf79bf11 tempest-VolumeQuotasNegativeTestJSON-209021508 None] Created volume successfully. Nov 02 12:44:56 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a 1073741824" returned: 0 in 0.688s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:56 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a Nov 02 12:44:56 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:56 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" returned: 0 in 0.369s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e58113-1173-4806-9011-b805e3997e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874cf543-affa-4c40-8e69-e1c2485eabcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Volume volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a (d740c3c6-b91c-4cc5-987d-a6af99a2a25a): created successfully Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874cf543-affa-4c40-8e69-e1c2485eabcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (8f7ac9f3-184d-4268-a332-45b85cc0baf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2c96d534-5e8c-4056-8bc9-74d2f83800b7 tempest-AttachVolumeNegativeTest-766111125 None] Created volume successfully. Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Acquiring lock "cinder-01292bee-f2cd-4bac-92a9-98031228192e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "cinder-01292bee-f2cd-4bac-92a9-98031228192e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Acquiring lock "cinder-quobyte-01292bee-f2cd-4bac-92a9-98031228192e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "cinder-quobyte-01292bee-f2cd-4bac-92a9-98031228192e" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad959240-2fd6-41c5-a636-644bb24c00d4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:58 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e Nov 02 12:44:58 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a541574b-bc0e-43ea-a272-68b22da8c194 req-403be633-a5c3-4f89-a063-67aaa821b292 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a541574b-bc0e-43ea-a272-68b22da8c194 req-403be633-a5c3-4f89-a063-67aaa821b292 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-a541574b-bc0e-43ea-a272-68b22da8c194 req-403be633-a5c3-4f89-a063-67aaa821b292 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:59 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e" returned: 0 in 0.646s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-a541574b-bc0e-43ea-a272-68b22da8c194 req-403be633-a5c3-4f89-a063-67aaa821b292 tempest-AttachVolumeNegativeTest-766111125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33649af7-6102-44a5-8c71-7d76f0d5b2f5', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:44:59 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e Nov 02 12:44:59 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-a541574b-bc0e-43ea-a272-68b22da8c194 req-403be633-a5c3-4f89-a063-67aaa821b292 tempest-AttachVolumeNegativeTest-766111125 None] attachment_update completed successfully. Nov 02 12:44:59 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-01292bee-f2cd-4bac-92a9-98031228192e" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "cinder-quobyte-01292bee-f2cd-4bac-92a9-98031228192e" released by "delete_volume" :: held 1.209s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Created reservations ['ffb5497e-2159-487e-b1e7-40bbff43fd22', 'dafb21d5-fb97-4938-81fd-a782897ae33a', '7a5162b6-1a84-496d-9a17-ee9ad9e5786f', 'c6f940a1-1bb4-47ac-bdb1-4639d98a9a9d'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:00 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Deleted volume successfully. Nov 02 12:45:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6c907c69-4216-4dc2-8640-d9ce6002743c tempest-VolumeQuotasNegativeTestJSON-209021508 None] Lock "cinder-01292bee-f2cd-4bac-92a9-98031228192e-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Flow 'volume_create_manager' (4ed87cc5-253d-40e5-9832-b973b4ed2678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd5c71-c4e0-4599-8b17-9b5b9035f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd5c71-c4e0-4599-8b17-9b5b9035f875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1064536086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9906c095-72b3-40e0-8fe4-57f35044240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bb40b28c3f405fb0b52608177ab022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e32a939d-dc6c-42ad-be03-1349bc71209e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:02Z,use_quota=True,user_id='e536a194b72f41b4ad8864619226f5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be2a14b-48b0-41c8-89f4-f5e209c78aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be2a14b-48b0-41c8-89f4-f5e209c78aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15978a6d-fb5f-4902-8bfa-bb3e3f851de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15978a6d-fb5f-4902-8bfa-bb3e3f851de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9906c095-72b3-40e0-8fe4-57f35044240f', 'volume_name': 'volume-9906c095-72b3-40e0-8fe4-57f35044240f', 'volume_size': 1, 'snapshot_id': 'e32a939d-dc6c-42ad-be03-1349bc71209e'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59684bc4-ad26-474d-96e4-8936ed594acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59684bc4-ad26-474d-96e4-8936ed594acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7629fff-33e7-477c-ad35-7afcfc27c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Volume 9906c095-72b3-40e0-8fe4-57f35044240f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9906c095-72b3-40e0-8fe4-57f35044240f', 'volume_size': 1, 'snapshot_id': 'e32a939d-dc6c-42ad-be03-1349bc71209e'} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e-9906c095-72b3-40e0-8fe4-57f35044240f" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e-9906c095-72b3-40e0-8fe4-57f35044240f" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Creating volume 9906c095-72b3-40e0-8fe4-57f35044240f from snapshot e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] snapshot: e32a939d-dc6c-42ad-be03-1349bc71209e, volume: 9906c095-72b3-40e0-8fe4-57f35044240f, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9919591-cb88-46d2-9a42-e925a1df6edb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:02 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:45:02 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:02 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.784s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3c8406-17fe-4f3e-993e-83647dfea958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5de388-bc91-4cb2-af2e-438798d0db96]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:03 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:45:03 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-5ff144aa-606a-43a0-8177-0838c59d3743 req-15bd113b-450b-4fdf-996f-18e90906899d tempest-AttachVolumeNegativeTest-766111125 None] Terminate volume connection completed successfully. Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-5ff144aa-606a-43a0-8177-0838c59d3743 req-15bd113b-450b-4fdf-996f-18e90906899d tempest-AttachVolumeNegativeTest-766111125 None] Deleting attachment 33649af7-6102-44a5-8c71-7d76f0d5b2f5. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:45:03 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.729s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:45:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:03 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f Nov 02 12:45:03 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:13 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=42,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:13 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:15 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f" returned: 0 in 11.961s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:15 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958, size 1024.00 MB, duration 11.96 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:45:15 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Converted 1024.00 MB image at 85.60 MB/s Nov 02 12:45:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f is being set with open permissions: ugo+rw Nov 02 12:45:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:15 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f Nov 02 12:45:15 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:16 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" released by "_copy_volume_from_snapshot" :: held 13.987s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e-9906c095-72b3-40e0-8fe4-57f35044240f" released by "_create_volume_from_snapshot" :: held 14.108s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.141s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7629fff-33e7-477c-ad35-7afcfc27c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9906c095-72b3-40e0-8fe4-57f35044240f', 'volume_size': 1, 'snapshot_id': 'e32a939d-dc6c-42ad-be03-1349bc71209e'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d76b9da-1a06-41ce-b5e7-a24630f85951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Volume volume-9906c095-72b3-40e0-8fe4-57f35044240f (9906c095-72b3-40e0-8fe4-57f35044240f): created successfully Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d76b9da-1a06-41ce-b5e7-a24630f85951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Flow 'volume_create_manager' (4ed87cc5-253d-40e5-9832-b973b4ed2678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-95c7dc0f-f749-4855-9e87-fc19a456c30c tempest-TestStampPattern-1463458724 None] Created volume successfully. Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Flow 'volume_create_manager' (08df15a0-52d1-4319-9406-2046819b78dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195971e4-ae6b-4b1e-a2ea-2d950e162e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195971e4-ae6b-4b1e-a2ea-2d950e162e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-968273499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d23caab-3f73-47c8-8f0e-36938bf50937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd447e22ac334938afe31f23e991a368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:18Z,use_quota=True,user_id='8e78a0db409e47bc9279495bb01d7671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20a799b5-36a7-4887-a90a-b31e2573e010),volume_type_id=20a799b5-36a7-4887-a90a-b31e2573e010)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4a9f49-2d95-4eb4-838c-b718dd7ff0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4a9f49-2d95-4eb4-838c-b718dd7ff0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b704757-cd17-4272-96c9-6394490bc4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b704757-cd17-4272-96c9-6394490bc4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d23caab-3f73-47c8-8f0e-36938bf50937', 'volume_name': 'volume-8d23caab-3f73-47c8-8f0e-36938bf50937', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eca0b4-4eeb-4e58-892b-16ea88419d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4eca0b4-4eeb-4e58-892b-16ea88419d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a434bc7-a837-48e4-b478-efe5666c1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Volume 8d23caab-3f73-47c8-8f0e-36938bf50937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d23caab-3f73-47c8-8f0e-36938bf50937', 'volume_size': 1} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-968273499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d23caab-3f73-47c8-8f0e-36938bf50937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd447e22ac334938afe31f23e991a368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:18Z,use_quota=True,user_id='8e78a0db409e47bc9279495bb01d7671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20a799b5-36a7-4887-a90a-b31e2573e010),volume_type_id=20a799b5-36a7-4887-a90a-b31e2573e010)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Creating volume 8d23caab-3f73-47c8-8f0e-36938bf50937 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:18 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:18 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 1073741824 Nov 02 12:45:18 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:18 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 1073741824" returned: 0 in 0.841s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:18 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 Nov 02 12:45:18 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:19 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a434bc7-a837-48e4-b478-efe5666c1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d23caab-3f73-47c8-8f0e-36938bf50937', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4fff99-f611-4c5a-baa1-21d232894a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Volume volume-8d23caab-3f73-47c8-8f0e-36938bf50937 (8d23caab-3f73-47c8-8f0e-36938bf50937): created successfully Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4fff99-f611-4c5a-baa1-21d232894a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Flow 'volume_create_manager' (08df15a0-52d1-4319-9406-2046819b78dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b1d31be1-7c36-4ad0-a3f0-4b3c1c6e3a8c tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Created volume successfully. Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:20 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:20 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:20 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-afbfbb2f-03c3-492a-bfdc-600a257bef13 tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Retype volume completed successfully. Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "cinder-8d23caab-3f73-47c8-8f0e-36938bf50937-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "cinder-8d23caab-3f73-47c8-8f0e-36938bf50937-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "cinder-quobyte-8d23caab-3f73-47c8-8f0e-36938bf50937" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "cinder-quobyte-8d23caab-3f73-47c8-8f0e-36938bf50937" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa5ac2-1634-48dc-a7bb-238dc40d980c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:22 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 Nov 02 12:45:22 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:22 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937" returned: 0 in 0.635s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:23 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937 Nov 02 12:45:23 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:23 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8d23caab-3f73-47c8-8f0e-36938bf50937" returned: 0 in 0.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "cinder-quobyte-8d23caab-3f73-47c8-8f0e-36938bf50937" released by "delete_volume" :: held 1.354s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:23 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:45:23 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:45:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Created reservations ['3b9399f9-6c22-478a-bce4-5722f2bf3913', 'b19dd51a-afda-465d-bab5-7c847dbc3efa', '91616e52-4f07-4286-8285-c450d9dff507', '7329676a-b19f-4a75-891d-bc1f4017eb84'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:24 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:24 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:24 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.571s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Deleted volume successfully. Nov 02 12:45:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea78df16-7754-467f-a77a-d3640ecd3d1e tempest-VolumeRetypeWithoutMigrationTest-1906929123 None] Lock "cinder-8d23caab-3f73-47c8-8f0e-36938bf50937-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:29 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:29 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.598s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:45:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:45:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:45:34 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:34 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Flow 'volume_create_manager' (8682f99a-3db2-43e0-8b70-5f3760910ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecfe57e-0758-4332-95bf-d4244e1be075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecfe57e-0758-4332-95bf-d4244e1be075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-526881186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd5a531-a6c2-440e-abe5-dca1208f6401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850e7c666f849d68174584822debcaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='b847cafd660546849a467034745fac07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8ff8e-7174-4f76-a81e-5a0b09dc230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8ff8e-7174-4f76-a81e-5a0b09dc230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2222c54f-d08d-453d-a96f-a4e5322b8acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2222c54f-d08d-453d-a96f-a4e5322b8acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffd5a531-a6c2-440e-abe5-dca1208f6401', 'volume_name': 'volume-ffd5a531-a6c2-440e-abe5-dca1208f6401', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4abde3-abf6-45ce-97e5-25cafd0281d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4abde3-abf6-45ce-97e5-25cafd0281d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c9f3ca-4c59-456e-985d-6ce5f9984963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Volume ffd5a531-a6c2-440e-abe5-dca1208f6401: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffd5a531-a6c2-440e-abe5-dca1208f6401', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:45:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Trying to clone ffd5a531-a6c2-440e-abe5-dca1208f6401 from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:45:47 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a12901-acda-44ba-8e67-4ad1cd89f731]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD Nov 02 12:45:47 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:47 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b is fetched for user b847cafd660546849a467034745fac07. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19b40a-9003-4339-a100-1c20bbb20085]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD Nov 02 12:45:47 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-526881186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd5a531-a6c2-440e-abe5-dca1208f6401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850e7c666f849d68174584822debcaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='b847cafd660546849a467034745fac07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Creating volume ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1073741824 Nov 02 12:45:48 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1073741824" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 Nov 02 12:45:48 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Attempting download of 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume ffd5a531-a6c2-440e-abe5-dca1208f6401. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b5a74-e198-4f1a-9043-1638b721a5cb]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr Nov 02 12:45:49 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr Nov 02 12:45:49 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:50 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr" returned: 1 in 0.491s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b__szlfosr' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5cb16-afb1-46f8-a268-88c0e5b2924e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:50 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD Nov 02 12:45:50 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-58ece066-aaa4-47d2-af85-364e21e7246f req-dcb04e0b-47f2-4f3d-b003-571d17991d1d tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-58ece066-aaa4-47d2-af85-364e21e7246f req-dcb04e0b-47f2-4f3d-b003-571d17991d1d tempest-TestStampPattern-1463458724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-58ece066-aaa4-47d2-af85-364e21e7246f req-dcb04e0b-47f2-4f3d-b003-571d17991d1d tempest-TestStampPattern-1463458724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-58ece066-aaa4-47d2-af85-364e21e7246f req-dcb04e0b-47f2-4f3d-b003-571d17991d1d tempest-TestStampPattern-1463458724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-9906c095-72b3-40e0-8fe4-57f35044240f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa828a9f-bdfd-4b73-8280-57c69f336903', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:45:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-58ece066-aaa4-47d2-af85-364e21e7246f req-dcb04e0b-47f2-4f3d-b003-571d17991d1d tempest-TestStampPattern-1463458724 None] attachment_update completed successfully. Nov 02 12:45:50 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:45:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:50 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 Nov 02 12:45:50 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:53 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401" returned: 0 in 2.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_kwub2jf3devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:45:53 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Converted 112.00 MB image at 44.56 MB/s Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:53 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1G Nov 02 12:45:53 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-fa3d67f5-61d8-4a51-b099-8c867c44869a req-f5648b51-d756-477e-92d8-6b7f83379df9 tempest-TestStampPattern-1463458724 None] Terminate volume connection completed successfully. Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-fa3d67f5-61d8-4a51-b099-8c867c44869a req-f5648b51-d756-477e-92d8-6b7f83379df9 tempest-TestStampPattern-1463458724 None] Deleting attachment fa828a9f-bdfd-4b73-8280-57c69f336903. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:45:53 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 1G" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Downloaded image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume ffd5a531-a6c2-440e-abe5-dca1208f6401 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b for user b847cafd660546849a467034745fac07 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Marking volume ffd5a531-a6c2-440e-abe5-dca1208f6401 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Copying metadata from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b to ffd5a531-a6c2-440e-abe5-dca1208f6401. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Creating volume glance metadata for volume ffd5a531-a6c2-440e-abe5-dca1208f6401 backed by image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c9f3ca-4c59-456e-985d-6ce5f9984963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd5a531-a6c2-440e-abe5-dca1208f6401', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f0573d-9fd9-4822-8615-e24f7916c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Volume volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 (ffd5a531-a6c2-440e-abe5-dca1208f6401): created successfully Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f0573d-9fd9-4822-8615-e24f7916c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Flow 'volume_create_manager' (8682f99a-3db2-43e0-8b70-5f3760910ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b53c3c11-5e69-418f-93f9-6ab0835938f0 tempest-VolumesImageMetadata-1444272039 None] Created volume successfully. Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Acquiring lock "cinder-ffd5a531-a6c2-440e-abe5-dca1208f6401-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "cinder-ffd5a531-a6c2-440e-abe5-dca1208f6401-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-11f654fc-fcc4-42ac-be5a-83b9c820dff1 req-fc6ea835-e83a-4ca9-a699-4b666415b1f1 tempest-TestMinimumBasicScenario-913775510 None] Terminate volume connection completed successfully. Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-11f654fc-fcc4-42ac-be5a-83b9c820dff1 req-fc6ea835-e83a-4ca9-a699-4b666415b1f1 tempest-TestMinimumBasicScenario-913775510 None] Deleting attachment 5a2ab781-bf76-489e-b737-b927791a5123. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Acquiring lock "cinder-quobyte-ffd5a531-a6c2-440e-abe5-dca1208f6401" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "cinder-quobyte-ffd5a531-a6c2-440e-abe5-dca1208f6401" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b910f2f-2c93-481f-8a37-281921d0d5a4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:54 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 Nov 02 12:45:54 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401 Nov 02 12:45:55 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "cinder-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "cinder-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:55 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ffd5a531-a6c2-440e-abe5-dca1208f6401" returned: 0 in 0.425s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "cinder-quobyte-ffd5a531-a6c2-440e-abe5-dca1208f6401" released by "delete_volume" :: held 0.998s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "cinder-quobyte-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "cinder-quobyte-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e4b74-f7f8-4da3-9eee-32fbfad436de]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Created reservations ['746ab23f-ed9e-449d-9483-7fa87599e577', '102e5a4f-5e22-46b3-9186-d1bea9bc0bf7', 'd009c48f-064c-4cf7-bd43-29a29692c141', 'ec22aed3-f32e-423c-bdd7-ea3f889d85c2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 Nov 02 12:45:56 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:56 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Deleted volume successfully. Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7f920634-daa5-4111-af9f-7073ae056740 tempest-VolumesImageMetadata-1444272039 None] Lock "cinder-ffd5a531-a6c2-440e-abe5-dca1208f6401-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:56 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3 Nov 02 12:45:56 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "cinder-quobyte-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3" released by "delete_volume" :: held 0.868s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Created reservations ['0ed6d80d-718d-4dd9-9f54-178dcbb7cbdc', 'b44f90da-5c97-45f9-9366-1b3d5d7c6a1f', '3f2aa504-2edb-4d6f-9b3b-333eb90beb8d', '025ea411-62c5-45ad-af77-97376e9b3a5e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:45:56 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Deleted volume successfully. Nov 02 12:45:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-839a5f84-9d8d-44f3-8ad0-4aaf9b7409e1 tempest-TestMinimumBasicScenario-913775510 None] Lock "cinder-dbb2dcc8-97c9-48c0-a5a6-23e76446e8a3-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-9906c095-72b3-40e0-8fe4-57f35044240f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "cinder-9906c095-72b3-40e0-8fe4-57f35044240f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" acquired by "delete_volume" :: waited 0.049s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc9ec36-6f07-40d1-8849-82ce048d7f7d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f Nov 02 12:45:58 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f" returned: 0 in 0.714s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:59 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f Nov 02 12:45:59 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9906c095-72b3-40e0-8fe4-57f35044240f" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-9906c095-72b3-40e0-8fe4-57f35044240f" released by "delete_volume" :: held 1.281s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Created reservations ['e46944ba-a615-4529-9f71-3a8e86cc3a6a', '8bacc999-ba31-4c0b-901d-f7d7d5bf80b1', '778186c9-81fa-4d10-b2e7-d7931be0fa6d', '2bf701df-c857-4509-9f59-733692987894'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:00 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Deleted volume successfully. Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-174b0ee4-79df-4ff7-9a51-67b585a2c4f6 tempest-TestStampPattern-1463458724 None] Lock "cinder-9906c095-72b3-40e0-8fe4-57f35044240f-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-e32a939d-dc6c-42ad-be03-1349bc71209e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-e32a939d-dc6c-42ad-be03-1349bc71209e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Deleting offline snapshot e32a939d-dc6c-42ad-be03-1349bc71209e of volume fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] snapshot_file for this snap is: volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee965b-6a99-4e81-87c2-3bc9622360a4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:01 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:46:01 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:01 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3c8406-17fe-4f3e-993e-83647dfea958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb685f-cb2b-445a-b60b-5e51879dfd95]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:01 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:46:01 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.658s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:46:02 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Flow 'volume_create_manager' (37c2ca26-4bea-4d81-8122-0d188fd90716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e1b697-6021-4b80-8041-ca218d77e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e1b697-6021-4b80-8041-ca218d77e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1310884544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea10e317-4df4-4598-97c6-8cd4274ef1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b551fa2e5da840d984099537d5dbc65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:02Z,use_quota=True,user_id='14aea81b968e438d9d24cccf33a4385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dcc4bf-0165-421b-a24e-afe93a2c7446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dcc4bf-0165-421b-a24e-afe93a2c7446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433488a4-b595-47ef-8c8e-2b81baa845bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433488a4-b595-47ef-8c8e-2b81baa845bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea10e317-4df4-4598-97c6-8cd4274ef1f5', 'volume_name': 'volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3588b12d-9bab-4002-9d4c-7c021ab16c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3588b12d-9bab-4002-9d4c-7c021ab16c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb602b29-f177-4e7c-a625-af942868b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Volume ea10e317-4df4-4598-97c6-8cd4274ef1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5', 'volume_size': 1} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1310884544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea10e317-4df4-4598-97c6-8cd4274ef1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b551fa2e5da840d984099537d5dbc65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:02Z,use_quota=True,user_id='14aea81b968e438d9d24cccf33a4385b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Creating volume ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 1073741824 Nov 02 12:46:02 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e Nov 02 12:46:02 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:03 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958.e32a939d-dc6c-42ad-be03-1349bc71209e" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-e32a939d-dc6c-42ad-be03-1349bc71209e" released by "_delete_snapshot" :: held 2.050s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" released by "delete_snapshot" :: held 2.077s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Created reservations ['3e350280-9d7c-4df4-ae96-b72bdd1445ae', '59307cbf-d578-497f-8edf-ac0e4c2d96ec', '820ad600-2714-4ed4-9f35-574545060a89', 'a6fa08a8-f805-4d49-b1d3-985c8ef05f12'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:03 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 1073741824" returned: 0 in 0.541s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Delete snapshot completed successfully. Nov 02 12:46:03 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 Nov 02 12:46:03 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-10d8f16a-af41-4b92-8536-e325824c60cb tempest-TestStampPattern-1463458724 None] Lock "cinder-e32a939d-dc6c-42ad-be03-1349bc71209e-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:03 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb602b29-f177-4e7c-a625-af942868b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eddf47-e9b6-49cb-870d-59c320c99eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Volume volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 (ea10e317-4df4-4598-97c6-8cd4274ef1f5): created successfully Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eddf47-e9b6-49cb-870d-59c320c99eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Flow 'volume_create_manager' (37c2ca26-4bea-4d81-8122-0d188fd90716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-52ab3f80-09a0-47b8-b06a-aad964916941 tempest-SnapshotMetadataTestJSON-1197016949 None] Created volume successfully. Nov 02 12:46:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Creating offline snapshot ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a of volume ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:46:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4856ce0-e51a-4731-baa2-4d6f09420800]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:04 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 Nov 02 12:46:04 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:05 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:05 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a 1G Nov 02 12:46:05 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a 1G" returned: 0 in 0.881s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:06 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a Nov 02 12:46:06 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a is being set with open permissions: ugo+rw Nov 02 12:46:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:06 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a Nov 02 12:46:06 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info Nov 02 12:46:07 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info is being set with open permissions: ugo+rw Nov 02 12:46:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info Nov 02 12:46:07 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.info" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b31c0c99-a0b7-4832-9084-ecf1b2c46366 tempest-SnapshotMetadataTestJSON-1197016949 None] Create snapshot completed successfully Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-fb3c8406-17fe-4f3e-993e-83647dfea958-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "cinder-fb3c8406-17fe-4f3e-993e-83647dfea958-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Acquiring lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd6b62-a980-4c07-9e8f-81ec25c18696]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:46:08 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958 Nov 02 12:46:08 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "cinder-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "cinder-quobyte-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Deleting offline snapshot ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a of volume ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] snapshot_file for this snap is: volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c76b74-c5ef-4118-bba0-cbe226ea1a4f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fb3c8406-17fe-4f3e-993e-83647dfea958" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "cinder-quobyte-fb3c8406-17fe-4f3e-993e-83647dfea958" released by "delete_volume" :: held 0.821s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:09 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a Nov 02 12:46:09 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Created reservations ['6f621077-eb25-4bcf-9ccd-b885adba3e46', '838a0f3e-14b8-4b9b-9719-04c5a9f4f9de', 'd9578b70-3f24-4ab2-aeeb-8460afb44aab', 'a820ce4b-3ad9-4c70-b72c-02bfba3060be'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:09 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" returned: 0 in 0.464s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f35f8c-6496-49d3-bac2-e8a61f31320b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Deleted volume successfully. Nov 02 12:46:09 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 Nov 02 12:46:09 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3115fcd7-3d1b-45f9-8599-d560a8160e99 tempest-TestStampPattern-1463458724 None] Lock "cinder-fb3c8406-17fe-4f3e-993e-83647dfea958-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:10 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a Nov 02 12:46:10 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:10 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a Nov 02 12:46:10 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5.ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a" released by "_delete_snapshot" :: held 1.699s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" released by "delete_snapshot" :: held 1.727s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Created reservations ['896ab761-4b9e-4a1b-9891-5af0eb5b25ef', '81b63346-c8ab-4f85-abb5-77e5f6735f1b', 'aa081bdf-874d-4f0d-a2d9-b1fef1f12a41', '127d6086-945d-4698-962b-433a3c810a48'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Delete snapshot completed successfully. Nov 02 12:46:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-19ffc0d0-bfca-4733-ad58-3e7650a699bd tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-ed3f4e69-9875-4142-bc1b-cb6f04b3fe2a-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "cinder-ea10e317-4df4-4598-97c6-8cd4274ef1f5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-ea10e317-4df4-4598-97c6-8cd4274ef1f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf4846-43d7-4c2e-975f-17da14a16349]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:11 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 Nov 02 12:46:11 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:11 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5" returned: 0 in 0.487s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:12 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5 Nov 02 12:46:12 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:12 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-ea10e317-4df4-4598-97c6-8cd4274ef1f5" returned: 0 in 0.338s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-quobyte-ea10e317-4df4-4598-97c6-8cd4274ef1f5" released by "delete_volume" :: held 0.908s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Created reservations ['fdfdc090-8813-4892-a2ec-b024cd88fa44', '0466c509-320f-4e15-bc8c-0b4aeb3c2d1c', '2fa9725b-6c17-4661-9480-40bca6c09830', 'ab7a47ed-9970-45cd-92c0-0b645ea02284'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:12 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:12 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:12 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Deleted volume successfully. Nov 02 12:46:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7c8388fa-c86a-4df3-9b28-f677cdc42fb8 tempest-SnapshotMetadataTestJSON-1197016949 None] Lock "cinder-ea10e317-4df4-4598-97c6-8cd4274ef1f5-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (9e0ac2ae-26e6-48e9-95d7-62f006713154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cccb533-f811-4ac8-9fce-888e31d3200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cccb533-f811-4ac8-9fce-888e31d3200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1588755910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7632f-e184-4d43-adcc-845f0a77b645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:14Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd31e8b5-cdfe-41f6-adb9-6dea431a92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd31e8b5-cdfe-41f6-adb9-6dea431a92d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98ac309-a0ac-46d7-9517-4dde0f637d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98ac309-a0ac-46d7-9517-4dde0f637d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be7632f-e184-4d43-adcc-845f0a77b645', 'volume_name': 'volume-0be7632f-e184-4d43-adcc-845f0a77b645', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8b14db-c063-449c-8f0c-83b5d80cb1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8b14db-c063-449c-8f0c-83b5d80cb1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6561a7e-ea47-42e5-82c6-b88ef90a0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Volume 0be7632f-e184-4d43-adcc-845f0a77b645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be7632f-e184-4d43-adcc-845f0a77b645', 'volume_size': 1} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1588755910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7632f-e184-4d43-adcc-845f0a77b645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9b5bd19b0464567b5a91e4c5a825d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:14Z,use_quota=True,user_id='2289e80090a9422cac642b95391613be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Creating volume 0be7632f-e184-4d43-adcc-845f0a77b645 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:14 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:14 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 1073741824 Nov 02 12:46:14 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:14 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 1073741824" returned: 0 in 0.572s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:14 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 Nov 02 12:46:14 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:15 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6561a7e-ea47-42e5-82c6-b88ef90a0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be7632f-e184-4d43-adcc-845f0a77b645', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f36887a-d29b-4b26-91b5-1a6c2e968fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Volume volume-0be7632f-e184-4d43-adcc-845f0a77b645 (0be7632f-e184-4d43-adcc-845f0a77b645): created successfully Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f36887a-d29b-4b26-91b5-1a6c2e968fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Flow 'volume_create_manager' (9e0ac2ae-26e6-48e9-95d7-62f006713154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-defbeda6-34a3-4392-a5e0-f8fbb85b2255 tempest-AttachVolumeNegativeTest-766111125 None] Created volume successfully. Nov 02 12:46:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-73069b2e-81db-4eb6-be91-6c9087237766 req-75733e03-ab56-4596-a83d-70719458ea00 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-73069b2e-81db-4eb6-be91-6c9087237766 req-75733e03-ab56-4596-a83d-70719458ea00 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-73069b2e-81db-4eb6-be91-6c9087237766 req-75733e03-ab56-4596-a83d-70719458ea00 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-73069b2e-81db-4eb6-be91-6c9087237766 req-75733e03-ab56-4596-a83d-70719458ea00 tempest-AttachVolumeNegativeTest-766111125 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-0be7632f-e184-4d43-adcc-845f0a77b645', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfdd3431-1e0c-4faf-a141-06be565a6d3f', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:46:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-73069b2e-81db-4eb6-be91-6c9087237766 req-75733e03-ab56-4596-a83d-70719458ea00 tempest-AttachVolumeNegativeTest-766111125 None] attachment_update completed successfully. Nov 02 12:46:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b3e27794-5287-4838-9d14-8ed9684db2a0 req-75b2d7dd-c831-40f7-9359-95ee41d1738f tempest-AttachVolumeNegativeTest-766111125 None] Terminate volume connection completed successfully. Nov 02 12:46:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-b3e27794-5287-4838-9d14-8ed9684db2a0 req-75b2d7dd-c831-40f7-9359-95ee41d1738f tempest-AttachVolumeNegativeTest-766111125 None] Deleting attachment dfdd3431-1e0c-4faf-a141-06be565a6d3f. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (2279d665-c3fc-42ff-a627-f37d313958d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf11f56-d93f-4ec9-a93c-95517bb1b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf11f56-d93f-4ec9-a93c-95517bb1b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333696483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b372f0-2510-4f7f-8a69-fc40d5a35619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ac464d0d14d33ae68d0ae143c4c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:24Z,use_quota=True,user_id='5452d168b5384a34b747ec7fd7efe8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfcbc79-d1cc-4199-92de-4e78cc3540ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfcbc79-d1cc-4199-92de-4e78cc3540ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2f0302-825d-446e-a63d-18e5ae598865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2f0302-825d-446e-a63d-18e5ae598865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b372f0-2510-4f7f-8a69-fc40d5a35619', 'volume_name': 'volume-20b372f0-2510-4f7f-8a69-fc40d5a35619', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d374d33a-149c-43fa-b458-3ce9e708dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d374d33a-149c-43fa-b458-3ce9e708dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2102c9da-000f-45f8-a057-276d4e3df6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Volume 20b372f0-2510-4f7f-8a69-fc40d5a35619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b372f0-2510-4f7f-8a69-fc40d5a35619', 'volume_size': 1} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333696483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b372f0-2510-4f7f-8a69-fc40d5a35619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ac464d0d14d33ae68d0ae143c4c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:24Z,use_quota=True,user_id='5452d168b5384a34b747ec7fd7efe8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Creating volume 20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:24 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:24 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 1073741824 Nov 02 12:46:24 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:25 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 1073741824" returned: 0 in 0.798s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:25 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:25 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:25 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2102c9da-000f-45f8-a057-276d4e3df6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b372f0-2510-4f7f-8a69-fc40d5a35619', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139221a0-343a-474c-9931-e5dddff05157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Volume volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 (20b372f0-2510-4f7f-8a69-fc40d5a35619): created successfully Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139221a0-343a-474c-9931-e5dddff05157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (2279d665-c3fc-42ff-a627-f37d313958d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-96b4e563-07e6-4b3c-a0ef-5befc15162a0 tempest-VolumesDeleteCascade-2048479874 None] Created volume successfully. Nov 02 12:46:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Creating offline snapshot 7755f365-3a9b-40f3-8870-65577216c31b of volume 20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:46:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b75fb-4522-4438-a3d2-cfa827994ba0]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:26 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:26 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:27 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:27 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b 1G Nov 02 12:46:27 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:27 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b 1G" returned: 0 in 0.630s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:27 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:27 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:28 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.509s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:28 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b is being set with open permissions: ugo+rw Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:28 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:28 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:28 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-0be7632f-e184-4d43-adcc-845f0a77b645-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:28 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info Nov 02 12:46:28 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-0be7632f-e184-4d43-adcc-845f0a77b645-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-quobyte-0be7632f-e184-4d43-adcc-845f0a77b645" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-0be7632f-e184-4d43-adcc-845f0a77b645" acquired by "delete_volume" :: waited 0.078s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:29 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:29 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b008ae-256f-46e2-a0c0-58a06d860a6c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:29 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info is being set with open permissions: ugo+rw Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:29 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info Nov 02 12:46:29 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:29 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 Nov 02 12:46:29 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:29 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:46:29 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:29 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645" returned: 0 in 0.659s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.info" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:29 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645 Nov 02 12:46:29 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d3b3c338-892b-4d64-989d-ea8071960097 tempest-VolumesDeleteCascade-2048479874 None] Create snapshot completed successfully Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Flow 'volume_create_manager' (c0e5d8d5-c0b7-4d28-bee5-b0871af72393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ecdc4f-b49a-4dcb-b1aa-d7e6bd242583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ecdc4f-b49a-4dcb-b1aa-d7e6bd242583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627322170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468faf9917814591b69fe5b6f7ecc6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:30Z,use_quota=True,user_id='1bcb7ec03a8a42d1aa8a6f281612ec34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec9659-40f6-46d4-a809-78dfa2410977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec9659-40f6-46d4-a809-78dfa2410977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc164d43-122e-4a02-9df2-ad1e562590da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc164d43-122e-4a02-9df2-ad1e562590da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a', 'volume_name': 'volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8f8e8b-010e-465f-9856-f25da9bcacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8f8e8b-010e-465f-9856-f25da9bcacdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296722c1-a53b-4171-8f14-821ddbed5915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Volume 931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a', 'volume_size': 1} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1627322170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468faf9917814591b69fe5b6f7ecc6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:30Z,use_quota=True,user_id='1bcb7ec03a8a42d1aa8a6f281612ec34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Creating volume 931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:30 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0be7632f-e184-4d43-adcc-845f0a77b645" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:30 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a 1073741824 Nov 02 12:46:30 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-0be7632f-e184-4d43-adcc-845f0a77b645" released by "delete_volume" :: held 1.231s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Created reservations ['0615482d-800b-473a-aa2c-16a4a1782856', '83137809-d56e-440f-a95c-2ed73150fe39', 'd966769e-0ce0-498a-b319-1235e292e082', '4dfbaa87-3f66-4681-875a-2b9c08dd616b'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:30 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:30 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:30 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a 1073741824" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:30 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Deleted volume successfully. Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1fd11223-b7b1-4839-9bbf-66f7a66ad4f8 tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-0be7632f-e184-4d43-adcc-845f0a77b645-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:30 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:30 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296722c1-a53b-4171-8f14-821ddbed5915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e415927c-3aac-4b86-8647-6b259d7efb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Volume volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a (931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a): created successfully Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e415927c-3aac-4b86-8647-6b259d7efb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Flow 'volume_create_manager' (c0e5d8d5-c0b7-4d28-bee5-b0871af72393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-02eb0f41-0ddc-438b-9d49-8387d5a164ad tempest-VolumeDependencyTests-2102813777 None] Created volume successfully. Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-d740c3c6-b91c-4cc5-987d-a6af99a2a25a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Creating offline snapshot fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b of volume 20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-d740c3c6-b91c-4cc5-987d-a6af99a2a25a-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac627903-cd2e-4198-adbd-080c09a9b611]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-quobyte-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ccb90c-e9e0-4ac3-be66-3870d08981a5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:31 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a Nov 02 12:46:31 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b372f0-2510-4f7f-8a69-fc40d5a35619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b 1G Nov 02 12:46:31 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a Nov 02 12:46:31 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-d740c3c6-b91c-4cc5-987d-a6af99a2a25a" released by "delete_volume" :: held 0.906s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Created reservations ['eaea53d1-f8bf-4ea1-9ce0-49230b7f61c4', '50d9fee4-34bd-420b-ae90-2134acd4b62d', '5257cd16-6e23-4386-9229-7847866b7e8b', '0f328981-ca72-4fa3-b77b-b4b9bb31192a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:32 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b 1G" returned: 0 in 0.650s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:32 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:32 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b is being set with open permissions: ugo+rw Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:32 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Deleted volume successfully. Nov 02 12:46:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ea1baccc-5104-461f-a8b6-9e88a62e4c5b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-d740c3c6-b91c-4cc5-987d-a6af99a2a25a-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:33 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Creating offline snapshot be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 of volume 931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:46:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-82baeb62-2a73-4587-9bd0-f2e439b9ebac tempest-VolumesDeleteCascade-2048479874 None] Create snapshot completed successfully Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1b73a-eb78-4f2f-a89a-38f4b8b55228]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:33 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-20b372f0-2510-4f7f-8a69-fc40d5a35619-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-20b372f0-2510-4f7f-8a69-fc40d5a35619-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Performing cascade delete. {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-7755f365-3a9b-40f3-8870-65577216c31b-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-7755f365-3a9b-40f3-8870-65577216c31b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-7755f365-3a9b-40f3-8870-65577216c31b" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-7755f365-3a9b-40f3-8870-65577216c31b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Deleting offline snapshot 7755f365-3a9b-40f3-8870-65577216c31b of volume 20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:46:33 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] snapshot_file for this snap is: volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.494s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e77ae-1f1d-47c1-b565-9dd5f7f6b7cb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 1G Nov 02 12:46:33 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:33 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:33 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "cinder-quobyte-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[645c7a78-a429-4f5e-ac99-292440d50188]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.502s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b372f0-2510-4f7f-8a69-fc40d5a35619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:34 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 Nov 02 12:46:34 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d3049e-337e-47e8-a536-9afd1682edc8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 1G" returned: 0 in 0.587s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:34 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:34 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2 Nov 02 12:46:34 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 is being set with open permissions: ugo+rw Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:34 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.566s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2786d60b-d10b-4740-95d6-9d7ce3858450]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-quobyte-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2" released by "delete_volume" :: held 0.878s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Created reservations ['7eb1a310-7409-47d5-9b94-19b67d7f40d8', '28706315-c096-4bb0-80dc-e2e747899335', '528da01d-e422-4729-81c1-84d19997529c', 'fe65ad97-fae2-4f1a-8e84-fedad08ec104'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:35 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:35 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.359s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info Nov 02 12:46:35 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Deleted volume successfully. Nov 02 12:46:35 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-73fed93c-34ba-46c7-95bd-ab76a566687b tempest-AttachVolumeNegativeTest-766111125 None] Lock "cinder-9a938dd6-9ce4-49c0-b4aa-5ef9b97486c2-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info is being set with open permissions: ugo+rw Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info Nov 02 12:46:35 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 0.649s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b372f0-2510-4f7f-8a69-fc40d5a35619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc80f5-9df9-4817-a93c-136f07d5bae0]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:35 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.info" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7eb77dfa-5729-4cb7-b259-32edc726821e tempest-VolumeDependencyTests-2102813777 None] Create snapshot completed successfully Nov 02 12:46:35 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b372f0-2510-4f7f-8a69-fc40d5a35619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c85c17b-c2a6-4015-a65e-33c654c1dbda]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:36 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:36 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:36 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:36 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b Nov 02 12:46:36 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.7755f365-3a9b-40f3-8870-65577216c31b" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b -F qcow2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:37 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b -F qcow2 Nov 02 12:46:37 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Flow 'volume_create_manager' (4668686d-f964-4ea4-8efb-a4af2c617366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d9b362-9b1d-4d3f-bc2a-eb17abb381cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d9b362-9b1d-4d3f-bc2a-eb17abb381cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-526360902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fa8b40-2049-427e-bcb8-9601396b8e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468faf9917814591b69fe5b6f7ecc6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:37Z,use_quota=True,user_id='1bcb7ec03a8a42d1aa8a6f281612ec34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7a5670-78ce-4b5a-a2e9-21e6b5b5ff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7a5670-78ce-4b5a-a2e9-21e6b5b5ff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b387c0-2e27-4dd1-a161-537d1a8b723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b387c0-2e27-4dd1-a161-537d1a8b723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2fa8b40-2049-427e-bcb8-9601396b8e91', 'volume_name': 'volume-d2fa8b40-2049-427e-bcb8-9601396b8e91', 'volume_size': 1, 'snapshot_id': 'be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437c52ad-5525-4abb-ac17-3c692df32d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437c52ad-5525-4abb-ac17-3c692df32d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ac70c-a72d-4d32-a97e-19f04f643849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Volume d2fa8b40-2049-427e-bcb8-9601396b8e91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2fa8b40-2049-427e-bcb8-9601396b8e91', 'volume_size': 1, 'snapshot_id': 'be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911'} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-d2fa8b40-2049-427e-bcb8-9601396b8e91" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-d2fa8b40-2049-427e-bcb8-9601396b8e91" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Creating volume d2fa8b40-2049-427e-bcb8-9601396b8e91 from snapshot be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] snapshot: be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911, volume: d2fa8b40-2049-427e-bcb8-9601396b8e91, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:46:37 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b -F qcow2" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbccea7-e149-4bae-8b73-57c35565806c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-7755f365-3a9b-40f3-8870-65577216c31b" released by "_delete_snapshot" :: held 4.190s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" released by "delete_snapshot" :: held 4.234s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:37 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:37 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['7bbfd283-adc6-4122-af6f-f055eddd9c87', '6672ee87-233e-4261-88e9-03ab10fa27a9', '6c2c1078-6973-46d8-8dcb-4a1d6117c40c', 'd81fa8d7-a7c9-49a3-9308-8b59d055d51f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Delete snapshot completed successfully. Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-7755f365-3a9b-40f3-8870-65577216c31b-delete_snapshot" released by "delete_snapshot" :: held 4.474s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Deleting offline snapshot fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b of volume 20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] snapshot_file for this snap is: volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[100a71b8-449a-44f7-8e0e-e59ee27a4a80]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.530s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b6287-ec5d-4287-a4b1-1de3da73b0cd]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:38 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:38 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:38 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:38 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 0.499s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b372f0-2510-4f7f-8a69-fc40d5a35619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c3cf75-9e58-4031-bf50-fbb9e33067f8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.458s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:46:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 Nov 02 12:46:38 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:38 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:38 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:39 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.514s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:39 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:39 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 0.747s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b Nov 02 12:46:40 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:41 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619.fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" returned: 0 in 1.056s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b" released by "_delete_snapshot" :: held 2.991s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" released by "delete_snapshot" :: held 3.042s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['28421276-3487-4966-9252-a8aeae970689', '6d460b6c-a289-4061-8b58-a0ef7127dae4', 'e2752c77-3d6e-4c33-8527-b2f46726d0bf', '3970cf2e-2300-465d-a2ee-47bf5d9812cc'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Delete snapshot completed successfully. Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-fb7a77f4-a7ab-46b3-8dc7-54fcf9de9b1b-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Snapshots deleted, issuing volume delete {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" acquired by "delete_volume" :: waited 0.055s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cf1ca4-e508-40ce-b92a-50b430bca43c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:41 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:41 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:42 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 0.737s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:42 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619 Nov 02 12:46:42 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:43 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-20b372f0-2510-4f7f-8a69-fc40d5a35619" returned: 0 in 1.003s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-20b372f0-2510-4f7f-8a69-fc40d5a35619" released by "delete_volume" :: held 1.931s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['c32d457b-9989-489b-9758-e21512590511', '8b19d5f6-4cdd-4b19-8040-ccf273c907ff', 'a5b6b71f-5c5e-42a1-a8c1-b6a71f33433d', '2b9c6842-c24c-46da-9f57-47e3946cfc57'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:43 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:43 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:44 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.684s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:44 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Deleted volume successfully. Nov 02 12:46:44 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=121,cinder:SELECT=108,cinder:INSERT=44,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:46:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-75d74435-21a2-4e1b-aa61-302872a83bea tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-20b372f0-2510-4f7f-8a69-fc40d5a35619-delete_volume" released by "delete_volume" :: held 11.163s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:46 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=124,cinder:UPDATE=119,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:46:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (e85aa6bb-5cb8-4215-a139-7ef65ef3f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0a8e81-d0e5-45af-9806-33afebd91147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0a8e81-d0e5-45af-9806-33afebd91147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1112901636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5098c34-c6cc-481c-b37a-a336b51a0b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ac464d0d14d33ae68d0ae143c4c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:47Z,use_quota=True,user_id='5452d168b5384a34b747ec7fd7efe8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eb6a37-68fc-4d3e-a006-4868177b1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9eb6a37-68fc-4d3e-a006-4868177b1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de37706-4307-41d0-9eaa-76007144fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de37706-4307-41d0-9eaa-76007144fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5098c34-c6cc-481c-b37a-a336b51a0b8c', 'volume_name': 'volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cc7780-9311-495c-9267-c1f2b823a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cc7780-9311-495c-9267-c1f2b823a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1f9052-c373-4908-93f4-9cd0890d6496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Volume d5098c34-c6cc-481c-b37a-a336b51a0b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c', 'volume_size': 1} Nov 02 12:46:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:48 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91" returned: 0 in 9.702s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:46:48 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Converted 1024.00 MB image at 105.53 MB/s Nov 02 12:46:48 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 is being set with open permissions: ugo+rw Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:48 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 Nov 02 12:46:48 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:48 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91" returned: 0 in 0.361s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" released by "_copy_volume_from_snapshot" :: held 11.192s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-d2fa8b40-2049-427e-bcb8-9601396b8e91" released by "_create_volume_from_snapshot" :: held 11.271s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.291s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1112901636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5098c34-c6cc-481c-b37a-a336b51a0b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ac464d0d14d33ae68d0ae143c4c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:47Z,use_quota=True,user_id='5452d168b5384a34b747ec7fd7efe8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Creating volume d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:48 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c 1073741824 Nov 02 12:46:48 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ac70c-a72d-4d32-a97e-19f04f643849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fa8b40-2049-427e-bcb8-9601396b8e91', 'volume_size': 1, 'snapshot_id': 'be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c206226-5363-4fb6-b798-b2661cecbb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Volume volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 (d2fa8b40-2049-427e-bcb8-9601396b8e91): created successfully Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c206226-5363-4fb6-b798-b2661cecbb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Flow 'volume_create_manager' (4668686d-f964-4ea4-8efb-a4af2c617366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ae1327bb-31c3-4930-a50c-6a45f92749bc tempest-VolumeDependencyTests-2102813777 None] Created volume successfully. Nov 02 12:46:49 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c 1073741824" returned: 0 in 0.520s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:49 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:46:49 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:49 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1f9052-c373-4908-93f4-9cd0890d6496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1440889-4300-4511-80a7-5555e8e54c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Volume volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c (d5098c34-c6cc-481c-b37a-a336b51a0b8c): created successfully Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1440889-4300-4511-80a7-5555e8e54c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (e85aa6bb-5cb8-4215-a139-7ef65ef3f772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eea42d35-d40f-47fa-85d4-15dd5a89a174 tempest-VolumesDeleteCascade-2048479874 None] Created volume successfully. Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Deleting offline snapshot be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 of volume 931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] snapshot_file for this snap is: volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa826486-6ade-4148-8937-0db6b42e1d9b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:50 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:50 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.501s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Creating offline snapshot 5bd03d48-efb3-46c8-84e9-01eb49bf5f43 of volume d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[39644e58-316a-47c6-8bf9-536073210c7c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85d246f-e74e-4846-af24-c84344a1f4d4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:46:50 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:50 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (469f87b7-0a78-4fdf-ac7a-c6c51fb6de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fda1cf-e4ac-4e20-964e-6e701e691cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fda1cf-e4ac-4e20-964e-6e701e691cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1927595155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c120c895-95c4-439d-a65e-bf01d8c749a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:51Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b0500b-b05e-4068-ba08-055d0bfe06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b0500b-b05e-4068-ba08-055d0bfe06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b2e8a-5ffc-4134-a735-0a16bc6ec23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117b2e8a-5ffc-4134-a735-0a16bc6ec23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c120c895-95c4-439d-a65e-bf01d8c749a6', 'volume_name': 'volume-c120c895-95c4-439d-a65e-bf01d8c749a6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98cc2bd-a9bc-4cd9-87b7-ed79682380fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98cc2bd-a9bc-4cd9-87b7-ed79682380fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8504e25b-e247-4b8c-82dc-7b22202df555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Volume c120c895-95c4-439d-a65e-bf01d8c749a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c120c895-95c4-439d-a65e-bf01d8c749a6', 'volume_size': 1} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:51 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.476s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:51 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 1G Nov 02 12:46:51 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.720s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:51 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:51 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 1G" returned: 0 in 0.475s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:51 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:46:51 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:51 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911 Nov 02 12:46:51 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 is being set with open permissions: ugo+rw Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:51 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:46:51 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a.be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911" released by "_delete_snapshot" :: held 2.034s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:51 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" released by "delete_snapshot" :: held 2.066s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Created reservations ['c4026124-9635-459e-a5ba-62ac52453228', '62a36be8-b1da-4b10-b082-66155aee9b41', '5a6f2196-ad4d-45ea-b4ec-873be4ae8d42', 'e3de96b5-2725-44e0-b2f1-167be68e8716'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Delete snapshot completed successfully. Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f0302cc4-bcbc-4b84-94b6-fcf291064aa2 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-be4bc83e-f0ee-4d1f-8bf6-77a9eecb9911-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:52 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info Nov 02 12:46:52 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info is being set with open permissions: ugo+rw Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info Nov 02 12:46:52 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.info" returned: 0 in 0.231s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1927595155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c120c895-95c4-439d-a65e-bf01d8c749a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:51Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Creating volume c120c895-95c4-439d-a65e-bf01d8c749a6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:52 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:46:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 1073741824 Nov 02 12:46:52 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9c5b4052-1e9f-4c26-ae3e-591952cbee48 tempest-VolumesDeleteCascade-2048479874 None] Create snapshot completed successfully Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[851507d9-b6b6-4124-b7d8-404790ea50ba]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:53 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 1073741824" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:53 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 Nov 02 12:46:53 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:53 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:53 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:53 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8504e25b-e247-4b8c-82dc-7b22202df555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c120c895-95c4-439d-a65e-bf01d8c749a6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27dd8de-ff7e-4ffd-93c5-fb04fa242db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Volume volume-c120c895-95c4-439d-a65e-bf01d8c749a6 (c120c895-95c4-439d-a65e-bf01d8c749a6): created successfully Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27dd8de-ff7e-4ffd-93c5-fb04fa242db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (469f87b7-0a78-4fdf-ac7a-c6c51fb6de73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:53 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c221e8d8-8225-4666-a404-35eb0e119c73 tempest-VolumesTestJSON-1976617110 None] Created volume successfully. Nov 02 12:46:53 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a Nov 02 12:46:53 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:54 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a" released by "delete_volume" :: held 1.088s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Created reservations ['167774aa-80ae-4dae-ab52-915c93432f1a', 'd3c59187-6bdc-486e-af64-2799f5e314e5', '59aaecf7-ae1c-4b6b-839d-bb686c3cfef7', '5f91467e-db33-419e-97ec-1ea1d918dba4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (2fb5df99-977d-4c70-9a2a-cd43ccee6c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456750f1-258d-4b55-8442-b3c637495d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456750f1-258d-4b55-8442-b3c637495d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-979831368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569b773d-f16f-4cb9-8056-b25c1b0d2733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7ac464d0d14d33ae68d0ae143c4c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bd03d48-efb3-46c8-84e9-01eb49bf5f43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:54Z,use_quota=True,user_id='5452d168b5384a34b747ec7fd7efe8ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff4c26-e8f0-4e0e-8258-dc7f7b227ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dff4c26-e8f0-4e0e-8258-dc7f7b227ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:54 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faeb1c69-de0e-4d44-a142-d9464e16fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faeb1c69-de0e-4d44-a142-d9464e16fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '569b773d-f16f-4cb9-8056-b25c1b0d2733', 'volume_name': 'volume-569b773d-f16f-4cb9-8056-b25c1b0d2733', 'volume_size': 1, 'snapshot_id': '5bd03d48-efb3-46c8-84e9-01eb49bf5f43'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15992551-0316-4cb7-b0e7-802696c31f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15992551-0316-4cb7-b0e7-802696c31f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5e8013-9f17-432d-93af-b2d1d675854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Volume 569b773d-f16f-4cb9-8056-b25c1b0d2733: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-569b773d-f16f-4cb9-8056-b25c1b0d2733', 'volume_size': 1, 'snapshot_id': '5bd03d48-efb3-46c8-84e9-01eb49bf5f43'} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-569b773d-f16f-4cb9-8056-b25c1b0d2733" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-569b773d-f16f-4cb9-8056-b25c1b0d2733" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Creating volume 569b773d-f16f-4cb9-8056-b25c1b0d2733 from snapshot 5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] snapshot: 5bd03d48-efb3-46c8-84e9-01eb49bf5f43, volume: 569b773d-f16f-4cb9-8056-b25c1b0d2733, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17124438-2300-40b7-9b69-4050bccccc32]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.523s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:55 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:46:55 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Deleted volume successfully. Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-041e61dd-4191-43c4-a838-2d273dd7281c tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-931d70e9-5ea4-4aa2-ba5d-aa6801de2d8a-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (1ce05b8c-5f16-4e58-a4d4-43a5b4f13b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3522d61-8404-4f37-a9f0-8787fec842a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3522d61-8404-4f37-a9f0-8787fec842a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2113938189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cf242-07f9-4769-905f-61d1a1d24b4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:55Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c193bf-fbb4-41ed-b49b-b5e77f2358a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c193bf-fbb4-41ed-b49b-b5e77f2358a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c691f9-37e3-43f6-b8bf-f5884f7d7560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c691f9-37e3-43f6-b8bf-f5884f7d7560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576cf242-07f9-4769-905f-61d1a1d24b4c', 'volume_name': 'volume-576cf242-07f9-4769-905f-61d1a1d24b4c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d07430-61ca-44d6-9cb7-5567bcc5d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d07430-61ca-44d6-9cb7-5567bcc5d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c66487c-6cf2-43a2-8641-ed1c686f8234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Volume 576cf242-07f9-4769-905f-61d1a1d24b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576cf242-07f9-4769-905f-61d1a1d24b4c', 'volume_size': 1} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-d2fa8b40-2049-427e-bcb8-9601396b8e91-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-d2fa8b40-2049-427e-bcb8-9601396b8e91-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ac1e83-ac1c-47f4-87e9-04dcfd9debad]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.810s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:46:55 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 Nov 02 12:46:55 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04274215-b226-407e-933a-052c97fd2e0e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:46:55 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:56 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91 Nov 02 12:46:56 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:56 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 Nov 02 12:46:56 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d2fa8b40-2049-427e-bcb8-9601396b8e91" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-quobyte-d2fa8b40-2049-427e-bcb8-9601396b8e91" released by "delete_volume" :: held 0.740s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Created reservations ['f0c55ad7-05a2-49a8-b238-10f162c1987f', '04c9995e-7dd9-4ed2-92d3-44d7a282880a', '1f441165-4399-48ba-9719-667a528b1ee9', '93968e33-b6d3-4dab-a5c5-a862a3e0970e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:56 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:46:56 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Deleted volume successfully. Nov 02 12:46:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-4498abb3-0152-4abb-800b-9d823da533b1 tempest-VolumeDependencyTests-2102813777 None] Lock "cinder-d2fa8b40-2049-427e-bcb8-9601396b8e91-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Flow 'volume_create_manager' (1af80c1e-adc0-49f0-ac05-d9fe4473eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47352356-e91f-44ef-ab1c-0bd348ac2b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47352356-e91f-44ef-ab1c-0bd348ac2b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc24c994-55ef-4148-8d5b-cc4bb8d78dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e8a03281f4dc38e07a29053560188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:06Z,use_quota=True,user_id='7379718b15c146c0bb60dba4ad78abab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613590c-65ea-42e5-af25-981185eb6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613590c-65ea-42e5-af25-981185eb6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60d621a-c616-44a4-b675-65bc8ec334f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60d621a-c616-44a4-b675-65bc8ec334f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc24c994-55ef-4148-8d5b-cc4bb8d78dc4', 'volume_name': 'volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800739c8-3e68-4c31-8087-f8cfa8618ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800739c8-3e68-4c31-8087-f8cfa8618ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16232065-ce57-428d-9ec5-5c3589fc2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Volume bc24c994-55ef-4148-8d5b-cc4bb8d78dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4', 'volume_size': 1} Nov 02 12:47:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:07 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733" returned: 0 in 11.092s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c, size 1024.00 MB, duration 11.09 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:47:07 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Converted 1024.00 MB image at 92.31 MB/s Nov 02 12:47:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 is being set with open permissions: ugo+rw Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:07 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 Nov 02 12:47:07 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:07 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" released by "_copy_volume_from_snapshot" :: held 12.729s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-569b773d-f16f-4cb9-8056-b25c1b0d2733" released by "_create_volume_from_snapshot" :: held 12.813s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.845s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.112s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2113938189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cf242-07f9-4769-905f-61d1a1d24b4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:55Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Creating volume 576cf242-07f9-4769-905f-61d1a1d24b4c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:07 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c 1073741824 Nov 02 12:47:07 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5e8013-9f17-432d-93af-b2d1d675854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569b773d-f16f-4cb9-8056-b25c1b0d2733', 'volume_size': 1, 'snapshot_id': '5bd03d48-efb3-46c8-84e9-01eb49bf5f43'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e61c9a-59d0-4a56-b290-a322ecf1b54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Volume volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 (569b773d-f16f-4cb9-8056-b25c1b0d2733): created successfully Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e61c9a-59d0-4a56-b290-a322ecf1b54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Flow 'volume_create_manager' (2fb5df99-977d-4c70-9a2a-cd43ccee6c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ad4962ab-d941-4e82-995e-383f1ab7dabb tempest-VolumesDeleteCascade-2048479874 None] Created volume successfully. Nov 02 12:47:08 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c 1073741824" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:08 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c Nov 02 12:47:08 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-d5098c34-c6cc-481c-b37a-a336b51a0b8c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-d5098c34-c6cc-481c-b37a-a336b51a0b8c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Performing cascade delete. {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:08 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.289s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc24c994-55ef-4148-8d5b-cc4bb8d78dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e8a03281f4dc38e07a29053560188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:06Z,use_quota=True,user_id='7379718b15c146c0bb60dba4ad78abab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Creating volume bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c66487c-6cf2-43a2-8641-ed1c686f8234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576cf242-07f9-4769-905f-61d1a1d24b4c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:08 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 1073741824 Nov 02 12:47:08 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ac997-4741-4d83-910a-be30f2e88bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Deleting offline snapshot 5bd03d48-efb3-46c8-84e9-01eb49bf5f43 of volume d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] snapshot_file for this snap is: volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58e316-8c65-4174-9216-dfb217f82cda]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Volume volume-576cf242-07f9-4769-905f-61d1a1d24b4c (576cf242-07f9-4769-905f-61d1a1d24b4c): created successfully Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292ac997-4741-4d83-910a-be30f2e88bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (1ce05b8c-5f16-4e58-a4d4-43a5b4f13b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0605d8db-c71e-4bdd-b7f5-2291b316687f tempest-VolumesTestJSON-1976617110 None] Created volume successfully. Nov 02 12:47:08 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:47:08 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:08 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 1073741824" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:09 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1d5a0-0963-41de-ae43-efc0ef4b41ec]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:09 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 Nov 02 12:47:09 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:09 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:47:09 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:09 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16232065-ce57-428d-9ec5-5c3589fc2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7d7ab0-1ff3-4cf4-8cc6-333c49f59509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Volume volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 (bc24c994-55ef-4148-8d5b-cc4bb8d78dc4): created successfully Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7d7ab0-1ff3-4cf4-8cc6-333c49f59509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Flow 'volume_create_manager' (1af80c1e-adc0-49f0-ac05-d9fe4473eecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1b4ccf51-3d9e-437d-83a3-4c95b99155b6 tempest-CinderUnicodeTest-1028214564 None] Created volume successfully. Nov 02 12:47:09 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.764s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:09 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:47:09 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (f2d18314-a221-4349-8804-5297ebc5b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eae102-26ec-4144-8931-937019cc4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46eae102-26ec-4144-8931-937019cc4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1881922553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adea70e-4a67-461d-97bb-e48b7da64aa4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:10Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13540db6-c1a6-4bd5-9563-27fdf3105a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13540db6-c1a6-4bd5-9563-27fdf3105a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17e3eb9-b6f8-4002-bb74-118491f44719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17e3eb9-b6f8-4002-bb74-118491f44719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adea70e-4a67-461d-97bb-e48b7da64aa4', 'volume_name': 'volume-0adea70e-4a67-461d-97bb-e48b7da64aa4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84c9f43-5b05-4fd9-88c8-be4c7a88ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84c9f43-5b05-4fd9-88c8-be4c7a88ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62c060c-29b3-4410-b950-b75aaf98519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Volume 0adea70e-4a67-461d-97bb-e48b7da64aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adea70e-4a67-461d-97bb-e48b7da64aa4', 'volume_size': 1} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1881922553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adea70e-4a67-461d-97bb-e48b7da64aa4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5aeb229b8abe4398bb02e0625dc51dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:10Z,use_quota=True,user_id='039e6d10ef6f473cb35dda7870cb2267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Creating volume 0adea70e-4a67-461d-97bb-e48b7da64aa4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:10 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:10 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 1073741824 Nov 02 12:47:10 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:10 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:10 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43 Nov 02 12:47:10 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:10 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 1073741824" returned: 0 in 0.571s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:10 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 Nov 02 12:47:10 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:10 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c.5bd03d48-efb3-46c8-84e9-01eb49bf5f43" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-5bd03d48-efb3-46c8-84e9-01eb49bf5f43" released by "_delete_snapshot" :: held 2.290s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" released by "delete_snapshot" :: held 2.363s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['2d882eed-800c-4e01-9a31-bb61aa5405a3', '5003a0df-bbbd-4c62-a431-607545295da0', '5e905771-ee47-41f5-8bf5-1658457fd550', '329393f9-4511-48fb-a480-ecce625b670a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Flow 'volume_create_manager' (1dfc35f0-2230-4c8a-a25d-0364191379d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4679ee5f-58f3-4fa6-8cf1-3420eb6e1294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4679ee5f-58f3-4fa6-8cf1-3420eb6e1294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1439272853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a87286-8409-4fda-9b3a-8946cb629fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e8a03281f4dc38e07a29053560188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:11Z,use_quota=True,user_id='7379718b15c146c0bb60dba4ad78abab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ce758a-316a-4233-aa9f-aaa58b5502c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ce758a-316a-4233-aa9f-aaa58b5502c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de896c5f-d761-466e-8431-d2a1af5b7efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de896c5f-d761-466e-8431-d2a1af5b7efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a87286-8409-4fda-9b3a-8946cb629fc9', 'volume_name': 'volume-24a87286-8409-4fda-9b3a-8946cb629fc9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f7dd2-aa13-4cc9-a9b8-72843649ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2f7dd2-aa13-4cc9-a9b8-72843649ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2221b-1aeb-4848-9ea9-5f0ab0fd015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Volume 24a87286-8409-4fda-9b3a-8946cb629fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a87286-8409-4fda-9b3a-8946cb629fc9', 'volume_size': 1} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1439272853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a87286-8409-4fda-9b3a-8946cb629fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e8a03281f4dc38e07a29053560188',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:11Z,use_quota=True,user_id='7379718b15c146c0bb60dba4ad78abab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Creating volume 24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62c060c-29b3-4410-b950-b75aaf98519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adea70e-4a67-461d-97bb-e48b7da64aa4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 1073741824 Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745fe42-de82-4bce-aa4c-b513b5e9e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Volume volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 (0adea70e-4a67-461d-97bb-e48b7da64aa4): created successfully Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4745fe42-de82-4bce-aa4c-b513b5e9e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Flow 'volume_create_manager' (f2d18314-a221-4349-8804-5297ebc5b31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Delete snapshot completed successfully. Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-5bd03d48-efb3-46c8-84e9-01eb49bf5f43-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Snapshots deleted, issuing volume delete {{(pid=86731) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2f66d17f-82d4-4452-acb1-97b2fb4bcb2f tempest-VolumesTestJSON-1976617110 None] Created volume successfully. Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d950d1b-e2a3-4892-8b3e-6ee9499a9a33]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:11 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:47:11 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:11 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 1073741824" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:11 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 Nov 02 12:47:11 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:11 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:11 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c Nov 02 12:47:11 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:11 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f2221b-1aeb-4848-9ea9-5f0ab0fd015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a87286-8409-4fda-9b3a-8946cb629fc9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6102224d-294e-4f77-9c58-ceb4bebc6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Volume volume-24a87286-8409-4fda-9b3a-8946cb629fc9 (24a87286-8409-4fda-9b3a-8946cb629fc9): created successfully Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6102224d-294e-4f77-9c58-ceb4bebc6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Flow 'volume_create_manager' (1dfc35f0-2230-4c8a-a25d-0364191379d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7f882fdb-a1d8-4791-8e24-30be868f5231 tempest-CinderUnicodeTest-1028214564 None] Created volume successfully. Nov 02 12:47:12 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d5098c34-c6cc-481c-b37a-a336b51a0b8c" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-d5098c34-c6cc-481c-b37a-a336b51a0b8c" released by "delete_volume" :: held 0.877s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['cad2a3e2-7f49-4910-ad36-9f352f31ef13', '87d4fefc-8574-4c6e-98b2-d54465d3240c', '70aa86b8-c4f5-4fca-b47d-9db0988a4956', '1c88f0d4-1f84-4ca8-b7a1-0b7d05247f83'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:12 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:12 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:12 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Deleted volume successfully. Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d65b0a2f-a7f8-449b-a7de-605405a74dbc tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-d5098c34-c6cc-481c-b37a-a336b51a0b8c-delete_volume" released by "delete_volume" :: held 4.216s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-569b773d-f16f-4cb9-8056-b25c1b0d2733-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-569b773d-f16f-4cb9-8056-b25c1b0d2733-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45ad64-0e41-4ebf-a88b-2d76266f573b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-0adea70e-4a67-461d-97bb-e48b7da64aa4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-0adea70e-4a67-461d-97bb-e48b7da64aa4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-quobyte-0adea70e-4a67-461d-97bb-e48b7da64aa4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:13 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 Nov 02 12:47:13 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-0adea70e-4a67-461d-97bb-e48b7da64aa4" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15503cd2-2815-4f47-92e0-c4ef2271f27b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Creating offline snapshot 05e60f52-0726-48ae-9b12-352941aa73c8 of volume 24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d9491-9b52-4cc1-a6a2-e0783c2bb392]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:13 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 Nov 02 12:47:13 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:13 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 Nov 02 12:47:13 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:13 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733" returned: 0 in 0.595s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:13 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733 Nov 02 12:47:13 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:13 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:13 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4 Nov 02 12:47:13 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:14 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-569b773d-f16f-4cb9-8056-b25c1b0d2733" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 1G Nov 02 12:47:14 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-quobyte-569b773d-f16f-4cb9-8056-b25c1b0d2733" released by "delete_volume" :: held 1.023s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Created reservations ['cfbd2de5-b736-4511-a059-2689ced73c23', '92ec6af3-6fb6-4694-ae94-314987980fc1', '1433d588-9d14-475c-ad79-0b5398a25370', '6a278671-d2c4-4f39-a41b-9a68448a0c89'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:14 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:14 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0adea70e-4a67-461d-97bb-e48b7da64aa4" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-0adea70e-4a67-461d-97bb-e48b7da64aa4" released by "delete_volume" :: held 0.953s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Created reservations ['a610c605-bd1d-4238-bc11-520ad5a83cbb', 'f9f7e70d-4a89-421e-8c6d-96c2934bb193', '204323dd-a47d-4ff5-a96d-f4052506dc33', '77e3e124-e885-4d0c-a55e-c53046c3cb8a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:14 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:14 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-576cf242-07f9-4769-905f-61d1a1d24b4c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:14 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "cinder-576cf242-07f9-4769-905f-61d1a1d24b4c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Deleted volume successfully. Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1942c343-181c-47c4-bcce-0212f13d2034 tempest-VolumesDeleteCascade-2048479874 None] Lock "cinder-569b773d-f16f-4cb9-8056-b25c1b0d2733-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-quobyte-576cf242-07f9-4769-905f-61d1a1d24b4c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-576cf242-07f9-4769-905f-61d1a1d24b4c" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:14 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 1G" returned: 0 in 0.644s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a87286-8409-4fda-9b3a-8946cb629fc9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[04464d7f-e3be-442a-b21f-00721222c549]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:14 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a87286-8409-4fda-9b3a-8946cb629fc9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 Nov 02 12:47:14 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c Nov 02 12:47:14 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Deleted volume successfully. Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4944927-bf47-4915-af2d-218f447a3956 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-0adea70e-4a67-461d-97bb-e48b7da64aa4-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:14 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24a87286-8409-4fda-9b3a-8946cb629fc9 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 is being set with open permissions: ugo+rw Nov 02 12:47:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 Nov 02 12:47:15 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:15 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c Nov 02 12:47:15 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:15 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info Nov 02 12:47:15 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:15 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-576cf242-07f9-4769-905f-61d1a1d24b4c" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-576cf242-07f9-4769-905f-61d1a1d24b4c" released by "delete_volume" :: held 0.728s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Created reservations ['a7b8c375-8244-4f7f-80a3-4028648c3ff2', '08da3495-8c71-4c9e-9f24-29011a7fdb62', '0f9bb3af-be14-4b81-a665-32818cf809b0', '79828afd-11eb-4f56-afae-641432cd9602'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:15 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:15 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info is being set with open permissions: ugo+rw Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info Nov 02 12:47:15 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-c120c895-95c4-439d-a65e-bf01d8c749a6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-c120c895-95c4-439d-a65e-bf01d8c749a6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "cinder-quobyte-c120c895-95c4-439d-a65e-bf01d8c749a6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:15 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-c120c895-95c4-439d-a65e-bf01d8c749a6" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Deleted volume successfully. Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1ee97-9f0f-4056-bf52-60a21832bdec]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-99e25c86-7d19-403a-af15-18a8bd26bb6d tempest-VolumesTestJSON-1976617110 None] Lock "cinder-576cf242-07f9-4769-905f-61d1a1d24b4c-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:15 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.info" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f6ffe94a-3950-46b0-8628-18b38d311e90 tempest-CinderUnicodeTest-1028214564 None] Create snapshot completed successfully Nov 02 12:47:16 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 Nov 02 12:47:16 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:16 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:16 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6 Nov 02 12:47:16 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-05e60f52-0726-48ae-9b12-352941aa73c8-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:16 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-05e60f52-0726-48ae-9b12-352941aa73c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c120c895-95c4-439d-a65e-bf01d8c749a6" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-quobyte-c120c895-95c4-439d-a65e-bf01d8c749a6" released by "delete_volume" :: held 0.849s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-quobyte-05e60f52-0726-48ae-9b12-352941aa73c8" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-05e60f52-0726-48ae-9b12-352941aa73c8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Deleting offline snapshot 05e60f52-0726-48ae-9b12-352941aa73c8 of volume 24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] snapshot_file for this snap is: volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3db265d-01ba-4afa-ae6a-8cfabdb96372]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Created reservations ['2340755c-d1fe-417b-b75a-df6458d9ba6a', '1468b2a4-0594-4fef-8bd2-16b4b45b1b9c', '21580f2c-3b71-468e-a103-1a061bfb2b36', '04ee6dc9-1243-4d98-95f0-e555300d66d1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:16 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 Nov 02 12:47:16 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:16 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:16 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:17 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.303s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Deleted volume successfully. Nov 02 12:47:17 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24a87286-8409-4fda-9b3a-8946cb629fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1c9c448e-a8dc-454f-8322-1d28b2a45717 tempest-VolumesTestJSON-1976617110 None] Lock "cinder-c120c895-95c4-439d-a65e-bf01d8c749a6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b1594-cfe1-42ac-b817-5b584403aba4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:17 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 Nov 02 12:47:17 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:17 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:17 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 Nov 02 12:47:17 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:18 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:18 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8 Nov 02 12:47:18 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:18 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9.05e60f52-0726-48ae-9b12-352941aa73c8" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-05e60f52-0726-48ae-9b12-352941aa73c8" released by "_delete_snapshot" :: held 1.774s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" released by "delete_snapshot" :: held 1.807s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Created reservations ['f55b6bfc-94fd-4646-9530-a4d9a35603f9', '4f6f0520-8629-477a-8dd5-44161afce78f', '19d7953e-ace0-4512-9004-20881f9e4de0', '41fbf9eb-777e-48df-8c3b-415e6c98eb81'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Delete snapshot completed successfully. Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-eccb0b82-0709-4e0a-83c1-e5c01441ce7a tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-05e60f52-0726-48ae-9b12-352941aa73c8-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-24a87286-8409-4fda-9b3a-8946cb629fc9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-24a87286-8409-4fda-9b3a-8946cb629fc9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc4dee-18fb-4053-9bde-62290a12e12e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:19 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 Nov 02 12:47:19 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:19 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:19 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9 Nov 02 12:47:19 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:19 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-24a87286-8409-4fda-9b3a-8946cb629fc9" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-24a87286-8409-4fda-9b3a-8946cb629fc9" released by "delete_volume" :: held 0.781s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Created reservations ['6c5cc568-da3d-46ff-aa03-9884fbb62928', '17841fb0-541b-478c-ae5a-5eb3c803c303', '03df15a1-72a3-4972-85bc-476a90b73dcb', '3b3b3732-12d2-463c-990c-50bae4490cf2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:19 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:19 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "cinder-quobyte-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:20 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Deleted volume successfully. Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c86a3d-9c39-4f7a-9bae-f78e0932ae9b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06365a99-2996-482d-a223-397876998330 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-24a87286-8409-4fda-9b3a-8946cb629fc9-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Flow 'volume_create_manager' (a9b0180b-0ba3-4e0b-9cb5-53e155c1a2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eacac1c-f9b9-4f93-a4d0-70094b64af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eacac1c-f9b9-4f93-a4d0-70094b64af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-64095645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8eac8ae05748f8954aefbb1ba3f6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:20Z,use_quota=True,user_id='aa7c016c2035446f877a798be31a027b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10488d2-f0ad-4b8b-b2c9-6a9462e957de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10488d2-f0ad-4b8b-b2c9-6a9462e957de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:20 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 Nov 02 12:47:20 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9221c4a4-fd6e-4572-958f-30fe539a0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9221c4a4-fd6e-4572-958f-30fe539a0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'volume_name': 'volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd965d9-805f-4ec6-addd-46d7b695949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd965d9-805f-4ec6-addd-46d7b695949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a74f6ce-e682-4b3a-9f7d-2db5e79e61cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Volume 82cd06a1-2d2c-4d58-94f9-53bab6b26f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'volume_size': 1} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-64095645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8eac8ae05748f8954aefbb1ba3f6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:20Z,use_quota=True,user_id='aa7c016c2035446f877a798be31a027b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Creating volume 82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:20 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e 1073741824 Nov 02 12:47:20 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:20 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" returned: 0 in 0.495s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:20 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4 Nov 02 12:47:20 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:21 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e 1073741824" returned: 0 in 0.609s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:21 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-quobyte-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4" released by "delete_volume" :: held 0.912s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:21 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:21 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Created reservations ['dc7e89e7-2f4a-4dd8-a998-338fd3b0f66f', '645da4f0-8e20-4a87-93b6-f4d3d06a1061', '5881bada-dd24-4242-84f1-6e8e96386483', '31c3439a-033f-40da-b6be-ec6e8c265b87'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:21 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:21 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:21 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a74f6ce-e682-4b3a-9f7d-2db5e79e61cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfb463f-b73b-49c9-9775-257866e6ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Volume volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e (82cd06a1-2d2c-4d58-94f9-53bab6b26f5e): created successfully Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfb463f-b73b-49c9-9775-257866e6ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Flow 'volume_create_manager' (a9b0180b-0ba3-4e0b-9cb5-53e155c1a2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8254408b-3d73-453c-993d-ea5e6a0ca9dd tempest-VolumesCloneTest-652847691 None] Created volume successfully. Nov 02 12:47:21 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Deleted volume successfully. Nov 02 12:47:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f8d06177-ad49-4ee5-8a10-f12ecbc66729 tempest-CinderUnicodeTest-1028214564 None] Lock "cinder-bc24c994-55ef-4148-8d5b-cc4bb8d78dc4-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e0f7ed70-f7ea-49d2-b17e-bf4c0edec13b tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-799736439: creating Nov 02 12:47:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e0f7ed70-f7ea-49d2-b17e-bf4c0edec13b tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-799736439: created successfully Nov 02 12:47:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e0f7ed70-f7ea-49d2-b17e-bf4c0edec13b tempest-GroupSnapshotsTest-5236120 None] Create group completed successfully. Nov 02 12:47:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Flow 'volume_create_manager' (d4b82725-9ea8-4cee-9a94-469ed919a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758b0683-b907-4bc0-aff8-12b0844d0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758b0683-b907-4bc0-aff8-12b0844d0791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-40934506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87964db5-f26e-44f6-8c40-69293267f095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8eac8ae05748f8954aefbb1ba3f6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:23Z,use_quota=True,user_id='aa7c016c2035446f877a798be31a027b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a75be-05e7-4aaa-89bb-398100bfda3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62a75be-05e7-4aaa-89bb-398100bfda3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac19c30-31c8-4626-a5cb-e554c0bc00aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac19c30-31c8-4626-a5cb-e554c0bc00aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '87964db5-f26e-44f6-8c40-69293267f095', 'volume_name': 'volume-87964db5-f26e-44f6-8c40-69293267f095', 'volume_size': 2, 'source_volid': '82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff561ace-c185-4fc9-94f6-e8371d8ada09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff561ace-c185-4fc9-94f6-e8371d8ada09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531ae5c8-0ebe-400e-8626-472e7c633e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Volume 87964db5-f26e-44f6-8c40-69293267f095: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-87964db5-f26e-44f6-8c40-69293267f095', 'volume_size': 2, 'source_volid': '82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'source_volstatus': 'available'} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Cloning volume 82cd06a1-2d2c-4d58-94f9-53bab6b26f5e to volume 87964db5-f26e-44f6-8c40-69293267f095 Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Creating offline snapshot 5214fd12-9d13-4d7f-8770-b034043007b2 of volume 82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a730a-24b2-43a5-a830-40d879c04e2d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:23 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:23 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:23 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.418s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:23 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 1G Nov 02 12:47:23 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (740af2dc-2cb4-4032-9dff-aa69d35a7f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f869ed-bb85-44b6-8e53-4e16a48f8009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f869ed-bb85-44b6-8e53-4e16a48f8009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927137230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=822efa8e-a5d4-4ce8-87d2-5394695f32c6,host='devstack@QuobyteHD#QuobyteHD',id=8258021d-d23a-46bf-8e56-c494b0d77946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:24Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4cd24a-b2d2-4b68-809c-4c1ca28642c1),volume_type_id=3b4cd24a-b2d2-4b68-809c-4c1ca28642c1)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:24 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159178a-80d9-4ee3-a902-3d06bfbf0ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159178a-80d9-4ee3-a902-3d06bfbf0ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf5089-28c8-4d59-9970-012e7b3fbcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf5089-28c8-4d59-9970-012e7b3fbcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8258021d-d23a-46bf-8e56-c494b0d77946', 'volume_name': 'volume-8258021d-d23a-46bf-8e56-c494b0d77946', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c468e00e-9d3f-4f95-8967-84e71655d1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c468e00e-9d3f-4f95-8967-84e71655d1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85e9e6d-3f22-437c-8b94-065a2b206940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:24 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Volume 8258021d-d23a-46bf-8e56-c494b0d77946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8258021d-d23a-46bf-8e56-c494b0d77946', 'volume_size': 1} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 1G" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:24 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:24 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:24 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:24 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 is being set with open permissions: ugo+rw Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:24 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:24 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:24 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:24 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info Nov 02 12:47:24 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:25 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:25 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info is being set with open permissions: ugo+rw Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:25 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info Nov 02 12:47:25 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:25 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.info" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] snapshot: 5214fd12-9d13-4d7f-8770-b034043007b2, volume: 87964db5-f26e-44f6-8c40-69293267f095, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d140e-9630-42aa-8665-ed20c2f73a6c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:25 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:25 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:25 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d2c703-02b0-4945-aa27-e342582e6893]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:25 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:25 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:26 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:47:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:47:26 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:47:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:26 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 Nov 02 12:47:26 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Flow 'volume_create_manager' (330084e4-62b2-47d6-9e95-2fcebf143a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0848c51b-6707-472a-ab2c-e9d37f4d75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0848c51b-6707-472a-ab2c-e9d37f4d75d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-993082156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14dd4a34-b086-432a-a8f5-2d0884146861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4ea01241794f6da3c716c8c75e5d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:28Z,use_quota=True,user_id='f45906bd1cc44c4e92c42c7270ac0a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6b1b2d-1bfe-4042-98ed-bfdbba7a4520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6b1b2d-1bfe-4042-98ed-bfdbba7a4520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa605d87-870d-4428-bbc2-71eaba050dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa605d87-870d-4428-bbc2-71eaba050dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14dd4a34-b086-432a-a8f5-2d0884146861', 'volume_name': 'volume-14dd4a34-b086-432a-a8f5-2d0884146861', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227d42ff-82bd-415d-8dd9-7b72d5fb7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227d42ff-82bd-415d-8dd9-7b72d5fb7830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1456e7-9583-4367-bc23-ed669eca4944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Volume 14dd4a34-b086-432a-a8f5-2d0884146861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14dd4a34-b086-432a-a8f5-2d0884146861', 'volume_size': 1} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:28 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:28 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:29 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:47:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:47:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:47:33 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095" returned: 0 in 7.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:47:33 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Converted 1024.00 MB image at 139.11 MB/s Nov 02 12:47:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 is being set with open permissions: ugo+rw Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:33 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 Nov 02 12:47:33 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:33 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" released by "_copy_volume_from_snapshot" :: held 8.449s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-quobyte-5214fd12-9d13-4d7f-8770-b034043007b2" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-5214fd12-9d13-4d7f-8770-b034043007b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Deleting offline snapshot 5214fd12-9d13-4d7f-8770-b034043007b2 of volume 82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] snapshot_file for this snap is: volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05bb9b-a5ba-4aa4-b486-b41b272c23c5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:33 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:33 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:34 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40420bd8-cdb3-47a9-a945-03a1593a6683]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:34 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:34 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (208caa55-b093-418b-a962-c3b7e8070945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f836de9-70c4-4a37-bc51-9d81672e9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f836de9-70c4-4a37-bc51-9d81672e9775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148336205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfdcffa-3e90-478e-b048-120f5616709c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:35Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5aa299-05b0-4f23-b222-e25fa9e987c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5aa299-05b0-4f23-b222-e25fa9e987c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f10a84f-3105-4ae2-a5a4-fd58e4fdd6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f10a84f-3105-4ae2-a5a4-fd58e4fdd6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfdcffa-3e90-478e-b048-120f5616709c', 'volume_name': 'volume-bbfdcffa-3e90-478e-b048-120f5616709c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930ba31b-ddd7-43b2-bf79-a690e35a3466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930ba31b-ddd7-43b2-bf79-a690e35a3466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba0dde-122b-4f15-b492-8482a796d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Volume bbfdcffa-3e90-478e-b048-120f5616709c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfdcffa-3e90-478e-b048-120f5616709c', 'volume_size': 1} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:34 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:34 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:34 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.323s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2 Nov 02 12:47:35 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e.5214fd12-9d13-4d7f-8770-b034043007b2" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-5214fd12-9d13-4d7f-8770-b034043007b2" released by "_delete_snapshot" :: held 1.631s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.357s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.276s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=822efa8e-a5d4-4ce8-87d2-5394695f32c6,created_at=2026-11-02T11:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927137230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=822efa8e-a5d4-4ce8-87d2-5394695f32c6,host='devstack@QuobyteHD#QuobyteHD',id=8258021d-d23a-46bf-8e56-c494b0d77946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:24Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b4cd24a-b2d2-4b68-809c-4c1ca28642c1),volume_type_id=3b4cd24a-b2d2-4b68-809c-4c1ca28642c1)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Creating volume 8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 1073741824 Nov 02 12:47:35 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531ae5c8-0ebe-400e-8626-472e7c633e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87964db5-f26e-44f6-8c40-69293267f095', 'volume_size': 2, 'source_volid': '82cd06a1-2d2c-4d58-94f9-53bab6b26f5e', 'source_volstatus': 'available'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be3d77-a019-40be-949e-c513ebd66e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Volume volume-87964db5-f26e-44f6-8c40-69293267f095 (87964db5-f26e-44f6-8c40-69293267f095): created successfully Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81be3d77-a019-40be-949e-c513ebd66e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Flow 'volume_create_manager' (d4b82725-9ea8-4cee-9a94-469ed919a561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1d7f9093-7e70-4d2a-960e-864005f3ccee tempest-VolumesCloneTest-652847691 None] Created volume successfully. Nov 02 12:47:35 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 1073741824" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:47:35 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:36 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.735s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-993082156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14dd4a34-b086-432a-a8f5-2d0884146861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4ea01241794f6da3c716c8c75e5d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:28Z,use_quota=True,user_id='f45906bd1cc44c4e92c42c7270ac0a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Creating volume 14dd4a34-b086-432a-a8f5-2d0884146861 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85e9e6d-3f22-437c-8b94-065a2b206940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8258021d-d23a-46bf-8e56-c494b0d77946', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 1073741824 Nov 02 12:47:36 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02011a9-ae4e-4c01-b95b-f816e3245279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Volume volume-8258021d-d23a-46bf-8e56-c494b0d77946 (8258021d-d23a-46bf-8e56-c494b0d77946): created successfully Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02011a9-ae4e-4c01-b95b-f816e3245279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (740af2dc-2cb4-4032-9dff-aa69d35a7f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1a0b4e67-f69d-4eec-9f42-96beea6d451d tempest-GroupSnapshotsTest-5236120 None] Created volume successfully. Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-87964db5-f26e-44f6-8c40-69293267f095-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "cinder-87964db5-f26e-44f6-8c40-69293267f095-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d317cc-5b10-4f28-a724-8cd05c83837c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:36 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:36 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 1073741824" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:36 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:36 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 Nov 02 12:47:36 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] GroupSnapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: creating. Nov 02 12:47:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Group snapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:37 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095 Nov 02 12:47:37 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.291s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-148336205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfdcffa-3e90-478e-b048-120f5616709c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:35Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Creating volume bbfdcffa-3e90-478e-b048-120f5616709c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:37 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1456e7-9583-4367-bc23-ed669eca4944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14dd4a34-b086-432a-a8f5-2d0884146861', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325fd19f-d8fe-439f-8076-fd138d3f2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:37 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c 1073741824 Nov 02 12:47:37 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Volume volume-14dd4a34-b086-432a-a8f5-2d0884146861 (14dd4a34-b086-432a-a8f5-2d0884146861): created successfully Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325fd19f-d8fe-439f-8076-fd138d3f2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Flow 'volume_create_manager' (330084e4-62b2-47d6-9e95-2fcebf143a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-da82052c-16e4-4621-99f4-dc2cb640538a tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Created volume successfully. Nov 02 12:47:37 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87964db5-f26e-44f6-8c40-69293267f095" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-87964db5-f26e-44f6-8c40-69293267f095" released by "delete_volume" :: held 0.790s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Created reservations ['41e30b3d-16f2-4ff1-8332-3ab744bc3e2b', '4ebd6ffc-1207-4b46-8b8e-0b8a2e388448', '063541dc-5f24-44a6-a1c6-9f6593587436', 'c84ca122-db32-42ee-acf6-68e6a71a8553'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:37 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c 1073741824" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c Nov 02 12:47:37 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:37 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Deleted volume successfully. Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "cinder-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-89b5f4dc-4a58-4f7a-bd42-d2bf2aaf700e tempest-VolumesCloneTest-652847691 None] Lock "cinder-87964db5-f26e-44f6-8c40-69293267f095-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Acquiring lock "cinder-quobyte-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c16751-e034-465b-ad33-9a1c1d09e84b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.967s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:37 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:37 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba0dde-122b-4f15-b492-8482a796d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfdcffa-3e90-478e-b048-120f5616709c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e87628-0f09-4a25-a01d-c95e54a0bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Creating offline snapshot efb5d72e-5d00-4b82-aa91-e3de124c309f of volume 8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:47:38 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Volume volume-bbfdcffa-3e90-478e-b048-120f5616709c (bbfdcffa-3e90-478e-b048-120f5616709c): created successfully Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e87628-0f09-4a25-a01d-c95e54a0bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (208caa55-b093-418b-a962-c3b7e8070945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1696e-a6bd-4209-b290-ca516468fe17]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2b41e3e7-f36f-4c6e-8461-b28b297c4c14 tempest-ProjectReaderTests-2027444404 None] Created volume successfully. Nov 02 12:47:38 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:47:38 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:38 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:38 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e Nov 02 12:47:38 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:38 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:38 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f 1G Nov 02 12:47:38 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:38 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "cinder-quobyte-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e" released by "delete_volume" :: held 0.781s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Created reservations ['4f41b43a-264f-457a-936f-8b1c4dc88895', '1a4e8d54-35f6-4eeb-9da1-b499acaf245b', 'c72a0ccf-a64d-41c3-ba23-f310652c9b8e', '32c088d3-5eff-41a3-8ce7-cf62efef959e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:38 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:38 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:39 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f 1G" returned: 0 in 0.621s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8258021d-d23a-46bf-8e56-c494b0d77946 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:39 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8258021d-d23a-46bf-8e56-c494b0d77946 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:47:39 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:39 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.437s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Deleted volume successfully. Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3c1e7468-3cae-4ea0-8596-b9941cbd0e02 tempest-VolumesCloneTest-652847691 None] Lock "cinder-82cd06a1-2d2c-4d58-94f9-53bab6b26f5e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-bbfdcffa-3e90-478e-b048-120f5616709c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-bbfdcffa-3e90-478e-b048-120f5616709c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-quobyte-bbfdcffa-3e90-478e-b048-120f5616709c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-bbfdcffa-3e90-478e-b048-120f5616709c" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e76b8a9-a12e-4678-881e-388f7ef02d9d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6a9aecc0-4322-4966-8dd1-1d4399082071 req-33675902-8137-487f-a733-0db8b91b57d7 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:39 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8258021d-d23a-46bf-8e56-c494b0d77946 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:39 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c Nov 02 12:47:39 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:39 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:47:39 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:39 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:39 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:39 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c Nov 02 12:47:39 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:39 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info Nov 02 12:47:39 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:40 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bbfdcffa-3e90-478e-b048-120f5616709c" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-bbfdcffa-3e90-478e-b048-120f5616709c" released by "delete_volume" :: held 0.746s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:40 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:40 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:40 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info Nov 02 12:47:40 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Created reservations ['50ac2e15-c384-49ad-b122-2740bdb6ebe1', '288b1c60-a630-4450-9f0b-6dcea540db7a', '2311d94e-20ad-4965-8290-f44a67cbc74f', '95a74b2a-00ad-410c-9398-5fb748640b6f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:40 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:40 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:40 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.info" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6a9aecc0-4322-4966-8dd1-1d4399082071 req-33675902-8137-487f-a733-0db8b91b57d7 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.086s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-6a9aecc0-4322-4966-8dd1-1d4399082071 req-33675902-8137-487f-a733-0db8b91b57d7 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-6a9aecc0-4322-4966-8dd1-1d4399082071 req-33675902-8137-487f-a733-0db8b91b57d7 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-14dd4a34-b086-432a-a8f5-2d0884146861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2263e8f-8e81-47bd-a52b-d15a8f1b32f3', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:47:40 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-06ab4387-8235-494b-9e5b-8df7024df70a tempest-GroupSnapshotsTest-5236120 None] group_snapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: created successfully Nov 02 12:47:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Deleted volume successfully. Nov 02 12:47:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-441d17f6-5241-4e40-83bd-1542001ca3d1 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-bbfdcffa-3e90-478e-b048-120f5616709c-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-6a9aecc0-4322-4966-8dd1-1d4399082071 req-33675902-8137-487f-a733-0db8b91b57d7 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] attachment_update completed successfully. Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (1d1865fc-d078-401d-8251-93f5cfeaaec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa3302-bbb5-42bf-8524-fbb02bb48866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaa3302-bbb5-42bf-8524-fbb02bb48866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360334574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8465b4c9-9d8a-4846-80b7-be356f1a1be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:41Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5cce0b-0d8b-478a-ab3e-255f9b31d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5cce0b-0d8b-478a-ab3e-255f9b31d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6f2f00-4657-41cf-bc22-aa6babe10463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6f2f00-4657-41cf-bc22-aa6babe10463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8465b4c9-9d8a-4846-80b7-be356f1a1be0', 'volume_name': 'volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c00b0a9-5e58-4dc8-8c7b-1a2868d39721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c00b0a9-5e58-4dc8-8c7b-1a2868d39721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f196e86d-42b5-4db9-bf50-a046f9902592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Volume 8465b4c9-9d8a-4846-80b7-be356f1a1be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0', 'volume_size': 1} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360334574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8465b4c9-9d8a-4846-80b7-be356f1a1be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:41Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Creating volume 8465b4c9-9d8a-4846-80b7-be356f1a1be0 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:41 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:41 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 1073741824 Nov 02 12:47:41 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:41 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 1073741824" returned: 0 in 0.670s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:42 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 Nov 02 12:47:42 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:42 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f196e86d-42b5-4db9-bf50-a046f9902592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80823990-e47a-4b92-8fcc-941722644f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Volume volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 (8465b4c9-9d8a-4846-80b7-be356f1a1be0): created successfully Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80823990-e47a-4b92-8fcc-941722644f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (1d1865fc-d078-401d-8251-93f5cfeaaec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6ebdc349-d426-4695-9afe-9a439bf8c9f2 tempest-ProjectReaderTests-2027444404 None] Created volume successfully. Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f-3555042f-6dc7-41c5-a1ae-0b731dbd64db" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f-3555042f-6dc7-41c5-a1ae-0b731dbd64db" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Creating volume 3555042f-6dc7-41c5-a1ae-0b731dbd64db from snapshot efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] snapshot: efb5d72e-5d00-4b82-aa91-e3de124c309f, volume: 3555042f-6dc7-41c5-a1ae-0b731dbd64db, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[98656f25-3848-4ef9-bbe8-8d24de5d0ba2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:42 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:47:42 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8258021d-d23a-46bf-8e56-c494b0d77946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-8465b4c9-9d8a-4846-80b7-be356f1a1be0-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[297082c1-f95d-4833-aa16-3055355d865a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-8465b4c9-9d8a-4846-80b7-be356f1a1be0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-quobyte-8465b4c9-9d8a-4846-80b7-be356f1a1be0" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:43 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-8465b4c9-9d8a-4846-80b7-be356f1a1be0" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:43 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[40daab34-2f8f-4af6-bf20-935d95654c95]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 Nov 02 12:47:43 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.502s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db Nov 02 12:47:43 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0 Nov 02 12:47:43 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:44 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8465b4c9-9d8a-4846-80b7-be356f1a1be0" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-8465b4c9-9d8a-4846-80b7-be356f1a1be0" released by "delete_volume" :: held 0.971s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Created reservations ['64526b0d-a0a6-43a8-901e-b10c24bf1739', 'af23d958-d9a7-4baf-a2a2-a05d34d1a63f', '94503bfd-ae98-4b8e-8c80-aa5ae82eef4a', '2b24ac13-f30e-416f-9b6e-0d9220cb0b01'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-b7987439-f69f-4367-bc0c-7c01c8f35b2f req-f38223da-410b-4b87-bfdb-00ff09385add tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Terminate volume connection completed successfully. Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-b7987439-f69f-4367-bc0c-7c01c8f35b2f req-f38223da-410b-4b87-bfdb-00ff09385add tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Deleting attachment d2263e8f-8e81-47bd-a52b-d15a8f1b32f3. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:44 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:44 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:45 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Deleted volume successfully. Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=173,cinder:SELECT=146,cinder:INSERT=50,cinder:DELETE=16 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0f1d26d0-694c-4cde-9d72-5bfdf1a91cc9 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-8465b4c9-9d8a-4846-80b7-be356f1a1be0-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "cinder-14dd4a34-b086-432a-a8f5-2d0884146861-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "cinder-14dd4a34-b086-432a-a8f5-2d0884146861-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "cinder-quobyte-14dd4a34-b086-432a-a8f5-2d0884146861" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "cinder-quobyte-14dd4a34-b086-432a-a8f5-2d0884146861" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c520e5d0-97df-485a-9d73-7fedb346770a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:46 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 Nov 02 12:47:46 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (61b20d15-6a97-456b-87cb-bb70f09044e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07794789-24a0-42c4-b642-33ab407900c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07794789-24a0-42c4-b642-33ab407900c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024399112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1249c369-5aad-4d8f-a78b-54f2cd35e48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:47Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635496c6-6ea8-4464-bdea-9b43a7a27293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635496c6-6ea8-4464-bdea-9b43a7a27293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925b66e7-0f54-46a4-9db1-6f4e3127b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925b66e7-0f54-46a4-9db1-6f4e3127b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1249c369-5aad-4d8f-a78b-54f2cd35e48d', 'volume_name': 'volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed59874-0df1-43eb-b70d-cae02f07f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed59874-0df1-43eb-b70d-cae02f07f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bea560-684a-4630-baca-9e83f25256ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Volume 1249c369-5aad-4d8f-a78b-54f2cd35e48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d', 'volume_size': 1} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:47 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861" returned: 0 in 1.046s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:47 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861 Nov 02 12:47:47 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:47 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-14dd4a34-b086-432a-a8f5-2d0884146861" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "cinder-quobyte-14dd4a34-b086-432a-a8f5-2d0884146861" released by "delete_volume" :: held 1.555s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=132,cinder:UPDATE=170,cinder:DELETE=13,cinder:INSERT=33 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Created reservations ['a22f69df-1f37-4bd5-bde3-95dd9c1bf4a6', '48da6de0-340c-4e03-9d9e-963f28922502', '39413d7b-065d-4001-88ec-243e67b6d806', 'ccbc3be5-2da2-49ce-8306-41c1c72d0ec4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:48 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:48 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:48 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Deleted volume successfully. Nov 02 12:47:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-103f87cf-0621-4be5-a168-5e2a2f9cddb5 tempest-TestServerVolumeAttachScenarioOldVersion-883540120 None] Lock "cinder-14dd4a34-b086-432a-a8f5-2d0884146861-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:53 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db" returned: 0 in 9.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946, size 1024.00 MB, duration 9.34 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:47:53 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Converted 1024.00 MB image at 109.67 MB/s Nov 02 12:47:53 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:53 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db Nov 02 12:47:53 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:53 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db" returned: 0 in 0.435s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" released by "_copy_volume_from_snapshot" :: held 10.922s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f-3555042f-6dc7-41c5-a1ae-0b731dbd64db" released by "_create_volume_from_snapshot" :: held 11.022s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.043s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.356s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1024399112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1249c369-5aad-4d8f-a78b-54f2cd35e48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:47Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Creating volume 1249c369-5aad-4d8f-a78b-54f2cd35e48d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:53 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:53 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d 1073741824 Nov 02 12:47:53 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c399002e-7537-4f4c-962d-ec0dd94ea000 tempest-GroupSnapshotsTest-5236120 None] Create group from source-snapshot-de92261b-2a33-4a03-a0c9-3a9e2352158f completed successfully. Nov 02 12:47:54 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d 1073741824" returned: 0 in 0.551s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:54 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d Nov 02 12:47:54 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:54 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10bea560-684a-4630-baca-9e83f25256ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baccbf5-6e08-4230-b603-22fdaba8c271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Volume volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d (1249c369-5aad-4d8f-a78b-54f2cd35e48d): created successfully Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baccbf5-6e08-4230-b603-22fdaba8c271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (61b20d15-6a97-456b-87cb-bb70f09044e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4de623af-0d0e-4984-a206-1576760ce72a tempest-ProjectReaderTests-2027444404 None] Created volume successfully. Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[591c2498-7b01-485c-a43a-13cfde1ce6e1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:55 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db Nov 02 12:47:55 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-1249c369-5aad-4d8f-a78b-54f2cd35e48d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-1249c369-5aad-4d8f-a78b-54f2cd35e48d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-quobyte-1249c369-5aad-4d8f-a78b-54f2cd35e48d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-1249c369-5aad-4d8f-a78b-54f2cd35e48d" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b0968-697f-40cc-9598-735d1117fd07]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:56 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db" returned: 0 in 0.553s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:56 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d Nov 02 12:47:56 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:56 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db Nov 02 12:47:56 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:56 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3555042f-6dc7-41c5-a1ae-0b731dbd64db" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-3555042f-6dc7-41c5-a1ae-0b731dbd64db" released by "delete_volume" :: held 0.984s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:56 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:56 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d Nov 02 12:47:56 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['aec777f1-0786-46a3-a647-da854b0b7358'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:56 devstack cinder-volume[86731]: WARNING cinder.quota [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-697182598 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-697182598, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:47:56 devstack cinder-volume[86731]: WARNING cinder.quota [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-697182598 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-697182598, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['547d4a7a-55fa-4454-aabd-6a3cf42213b5', '2c3763e7-f207-46b2-9b6c-bceb57d0d4b7', '605640e7-a8e5-42c4-918f-2067b016706a', '3c57644f-3c8d-410e-b9e0-d0529901b471'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:56 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1249c369-5aad-4d8f-a78b-54f2cd35e48d" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-1249c369-5aad-4d8f-a78b-54f2cd35e48d" released by "delete_volume" :: held 0.902s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Created reservations ['5c9b8fca-f081-4de0-928c-d0536d0bf422', '47c01849-1313-4956-aede-c2939773d145', '350a1892-94c3-43f8-8c29-f9a4f7795e92', '65d095df-e3b9-468d-aeb8-88f08f2560ca'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:57 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:57 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:57 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:47:57 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:57 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-711f21a9-cebe-480f-bee5-4a3b14211736 tempest-GroupSnapshotsTest-5236120 None] Delete group completed successfully. Nov 02 12:47:57 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Deleted volume successfully. Nov 02 12:47:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fe5e395d-0a2b-43dc-af5d-85f63c0c5852 tempest-ProjectReaderTests-2027444404 None] Lock "cinder-1249c369-5aad-4d8f-a78b-54f2cd35e48d-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] group_snapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: deleting Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] group_snapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Deleting offline snapshot efb5d72e-5d00-4b82-aa91-e3de124c309f of volume 8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] snapshot_file for this snap is: volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6fb0f-56c4-4065-9cd5-5dc94d1ddd5f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:58 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:47:58 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:58 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.604s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8258021d-d23a-46bf-8e56-c494b0d77946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0b36f-6f74-4fa0-9ca3-c8b3379d17f9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (b9c08610-864d-4a31-b3b4-daa802322ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86115a9-c753-443c-a947-51d58f21c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86115a9-c753-443c-a947-51d58f21c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653344956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56348a6c-3961-4995-88ca-d5caaa6b0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:59Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbcbec1-a859-47f2-95d2-df345c94554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbcbec1-a859-47f2-95d2-df345c94554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac7dfa0-97d5-49ea-b0df-0e6c3654078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac7dfa0-97d5-49ea-b0df-0e6c3654078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56348a6c-3961-4995-88ca-d5caaa6b0c0c', 'volume_name': 'volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7809fe13-ff4f-491d-8294-710172d02f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7809fe13-ff4f-491d-8294-710172d02f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d70506c-f471-4453-b36f-916bc37d4193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Volume 56348a6c-3961-4995-88ca-d5caaa6b0c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c', 'volume_size': 1} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653344956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56348a6c-3961-4995-88ca-d5caaa6b0c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff9bdf9cf7054fc2bb8352eabff0d699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:59Z,use_quota=True,user_id='5bf2cf3f358442c2b4fc796733271166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Creating volume 56348a6c-3961-4995-88ca-d5caaa6b0c0c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:59 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:47:59 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:59 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c 1073741824 Nov 02 12:47:59 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:59 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.677s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:59 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:47:59 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:59 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c 1073741824" returned: 0 in 0.598s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:59 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c Nov 02 12:47:59 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:00 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d70506c-f471-4453-b36f-916bc37d4193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598845d5-1c52-4bab-8338-7d266110f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Volume volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c (56348a6c-3961-4995-88ca-d5caaa6b0c0c): created successfully Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598845d5-1c52-4bab-8338-7d266110f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:00 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Flow 'volume_create_manager' (b9c08610-864d-4a31-b3b4-daa802322ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.609s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e964d385-31dd-40e0-a6c6-b423aacf7a46 tempest-ProjectReaderTests-2027444404 None] Created volume successfully. Nov 02 12:48:00 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f Nov 02 12:48:00 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:00 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946.efb5d72e-5d00-4b82-aa91-e3de124c309f" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-efb5d72e-5d00-4b82-aa91-e3de124c309f" released by "_delete_snapshot" :: held 2.399s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" released by "delete_snapshot" :: held 2.439s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:00 devstack cinder-volume[86731]: WARNING cinder.quota [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-697182598 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-697182598, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['fad7fecc-ed20-47c6-b144-6d0ef8635970', '67751a64-aa66-4c3e-a744-cf936745adf2', 'd0d85736-02d7-4209-8158-3efc808a48d9', '6b1c7b1f-fd54-44da-a084-77428694267a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-547a8e2f-57a4-4cfa-9a0e-79e109ce7526 tempest-GroupSnapshotsTest-5236120 None] group_snapshot de92261b-2a33-4a03-a0c9-3a9e2352158f: deleted successfully Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-56348a6c-3961-4995-88ca-d5caaa6b0c0c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "cinder-56348a6c-3961-4995-88ca-d5caaa6b0c0c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Acquiring lock "cinder-quobyte-56348a6c-3961-4995-88ca-d5caaa6b0c0c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-56348a6c-3961-4995-88ca-d5caaa6b0c0c" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e99d9-b029-4252-964c-225d729a69a0]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:01 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c Nov 02 12:48:01 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:01 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:01 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c Nov 02 12:48:01 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b7e67-4c2e-4abf-aba8-f97441351e06]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:02 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-56348a6c-3961-4995-88ca-d5caaa6b0c0c" returned: 0 in 0.566s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:02 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:48:02 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "cinder-quobyte-56348a6c-3961-4995-88ca-d5caaa6b0c0c" released by "delete_volume" :: held 1.091s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Created reservations ['3ffdc1ae-a099-4139-bd3e-30d85d024c67', '36b03472-7749-41d9-8a6f-5a5c7f587182', '083f7a19-3a76-4a29-b6b1-b54b3359f553', '118e8b38-9445-4c4d-a64f-a40c2ea412fb'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (60ed00f2-f695-43e6-8502-3bb38b45604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244169b-f100-441c-8e50-029ab6a9d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f244169b-f100-441c-8e50-029ab6a9d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564649857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062f7c1c-855e-44cb-9354-9cbfab2d9dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:02Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9082d4-b7d7-4c18-86be-0285e1dad8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9082d4-b7d7-4c18-86be-0285e1dad8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7439e-7a62-4929-942f-595aa78c1f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7439e-7a62-4929-942f-595aa78c1f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062f7c1c-855e-44cb-9354-9cbfab2d9dd4', 'volume_name': 'volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a93e6c0-22d2-4983-bfe9-8c8b8dbfc36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a93e6c0-22d2-4983-bfe9-8c8b8dbfc36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acc5c66-7093-4582-91a4-e8dab444557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:02 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Volume 062f7c1c-855e-44cb-9354-9cbfab2d9dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4', 'volume_size': 1} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564649857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062f7c1c-855e-44cb-9354-9cbfab2d9dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:02Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Creating volume 062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:02 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 1073741824 Nov 02 12:48:02 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.574s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:02 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:02 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:02 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946 Nov 02 12:48:02 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:02 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Deleted volume successfully. Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-33c9b4e4-68c6-4629-ab63-08608f8d229e tempest-ProjectReaderTests-2027444404 None] Lock "cinder-56348a6c-3961-4995-88ca-d5caaa6b0c0c-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:03 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8258021d-d23a-46bf-8e56-c494b0d77946" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-8258021d-d23a-46bf-8e56-c494b0d77946" released by "delete_volume" :: held 1.153s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Created reservations ['e5a76036-aca0-4599-8be2-e81eadad8269'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:03 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 1073741824" returned: 0 in 0.671s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:03 devstack cinder-volume[86731]: WARNING cinder.db.api [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-697182598'] Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Created reservations ['e07f521d-629b-473b-8101-c17cdcf3db10', '594e29f0-8ef3-440f-9735-a0d45161ff0d', 'd5a77263-ff78-42f0-905e-1ed260fdec61', '9184617e-6d01-4452-9930-4b2e119c2afc'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:03 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 Nov 02 12:48:03 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:03 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:03 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:03 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" returned: 0 in 0.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acc5c66-7093-4582-91a4-e8dab444557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5e6df6-ec82-48b5-8289-c8f6a7c1131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Volume volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 (062f7c1c-855e-44cb-9354-9cbfab2d9dd4): created successfully Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5e6df6-ec82-48b5-8289-c8f6a7c1131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (60ed00f2-f695-43e6-8502-3bb38b45604a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e322eed1-1e3f-4a47-bc3d-69013af9bf82 tempest-VolumesSnapshotTestJSON-613737112 None] Created volume successfully. Nov 02 12:48:03 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f4a86fc0-dddb-483e-b096-26b289dc6efe tempest-GroupSnapshotsTest-5236120 None] Delete group completed successfully. Nov 02 12:48:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0cd62cc7-7c9f-4b31-b776-869daf3dad2f tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-1413165367: creating Nov 02 12:48:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0cd62cc7-7c9f-4b31-b776-869daf3dad2f tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-1413165367: created successfully Nov 02 12:48:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0cd62cc7-7c9f-4b31-b776-869daf3dad2f tempest-GroupSnapshotsTest-5236120 None] Create group completed successfully. Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Creating offline snapshot 9b9289c7-9c5f-4089-964d-c4f906d9a2aa of volume 062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0335b9d8-7808-49c7-acab-068683d37da1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:05 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 Nov 02 12:48:05 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:05 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" returned: 0 in 0.401s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:05 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa 1G Nov 02 12:48:05 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:06 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa 1G" returned: 0 in 0.523s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:06 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa Nov 02 12:48:06 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:06 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa is being set with open permissions: ugo+rw Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:06 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa Nov 02 12:48:06 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (ed1c13e7-e8f4-4219-9c47-b39a37674093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953e2c6d-a479-47c5-b5ac-ffece592667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953e2c6d-a479-47c5-b5ac-ffece592667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273142420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f39c8f3-abac-495b-94d3-28011f007917,host='devstack@QuobyteHD#QuobyteHD',id=30b78b15-fb42-4ab9-bc45-528ed8ce5b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:07Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b3c8f1-7419-4697-8546-a7b653be1de5),volume_type_id=f8b3c8f1-7419-4697-8546-a7b653be1de5)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85cf069-39a1-4815-8973-6f93ffb8a6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85cf069-39a1-4815-8973-6f93ffb8a6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9018471c-271f-4d3e-9233-ada9e03621d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9018471c-271f-4d3e-9233-ada9e03621d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b78b15-fb42-4ab9-bc45-528ed8ce5b13', 'volume_name': 'volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a00bc40-4029-497a-89c8-37bbbfa5b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a00bc40-4029-497a-89c8-37bbbfa5b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199580b7-4872-4586-8a45-ca1c7b42ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Volume 30b78b15-fb42-4ab9-bc45-528ed8ce5b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13', 'volume_size': 1} Nov 02 12:48:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:06 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:07 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info Nov 02 12:48:07 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:07 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info is being set with open permissions: ugo+rw Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:07 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info Nov 02 12:48:07 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:07 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.info" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f39c8f3-abac-495b-94d3-28011f007917,created_at=2026-11-02T11:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273142420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f39c8f3-abac-495b-94d3-28011f007917,host='devstack@QuobyteHD#QuobyteHD',id=30b78b15-fb42-4ab9-bc45-528ed8ce5b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:07Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b3c8f1-7419-4697-8546-a7b653be1de5),volume_type_id=f8b3c8f1-7419-4697-8546-a7b653be1de5)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Creating volume 30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:07 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 1073741824 Nov 02 12:48:07 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6da2d686-c9ec-4ffc-a57e-95bd9bd62bb6 tempest-VolumesSnapshotTestJSON-613737112 None] Create snapshot completed successfully Nov 02 12:48:08 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 1073741824" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:08 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 Nov 02 12:48:08 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:08 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199580b7-4872-4586-8a45-ca1c7b42ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf99ea-223a-47d7-9c92-2c16a716bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Volume volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 (30b78b15-fb42-4ab9-bc45-528ed8ce5b13): created successfully Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf99ea-223a-47d7-9c92-2c16a716bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (ed1c13e7-e8f4-4219-9c47-b39a37674093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-142ee259-a633-4697-ada5-735a467c8b17 tempest-GroupSnapshotsTest-5236120 None] Created volume successfully. Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-9b9289c7-9c5f-4089-964d-c4f906d9a2aa-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-9b9289c7-9c5f-4089-964d-c4f906d9a2aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-9b9289c7-9c5f-4089-964d-c4f906d9a2aa" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-9b9289c7-9c5f-4089-964d-c4f906d9a2aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Deleting offline snapshot 9b9289c7-9c5f-4089-964d-c4f906d9a2aa of volume 062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] snapshot_file for this snap is: volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c889441e-3e72-434f-b8e2-687c160b7579]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:08 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa Nov 02 12:48:08 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:09 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1852e84d-bbc5-4d3c-855e-d1a821a78f4a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:09 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 Nov 02 12:48:09 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:09 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:09 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa Nov 02 12:48:09 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (002a4c15-3251-4d20-ae2d-f58d4536ad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c9d78d-ed95-47c2-8404-41f14e029292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c9d78d-ed95-47c2-8404-41f14e029292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136528091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f39c8f3-abac-495b-94d3-28011f007917,host='devstack@QuobyteHD#QuobyteHD',id=7356b5e8-6cc7-43cd-a18f-badcf8eb203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:10Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b3c8f1-7419-4697-8546-a7b653be1de5),volume_type_id=f8b3c8f1-7419-4697-8546-a7b653be1de5)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0676db-ebd2-410f-add4-0f43dd9876c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0676db-ebd2-410f-add4-0f43dd9876c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84aa88-6a32-4f92-a9cc-e5e9396cc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84aa88-6a32-4f92-a9cc-e5e9396cc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7356b5e8-6cc7-43cd-a18f-badcf8eb203c', 'volume_name': 'volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb644d-1032-4ff6-a175-b688ac34cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb644d-1032-4ff6-a175-b688ac34cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb9aca5-43d6-46bc-ac81-9198dd01dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Volume 7356b5e8-6cc7-43cd-a18f-badcf8eb203c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c', 'volume_size': 1} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f39c8f3-abac-495b-94d3-28011f007917,created_at=2026-11-02T11:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-136528091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f39c8f3-abac-495b-94d3-28011f007917,host='devstack@QuobyteHD#QuobyteHD',id=7356b5e8-6cc7-43cd-a18f-badcf8eb203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:10Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8b3c8f1-7419-4697-8546-a7b653be1de5),volume_type_id=f8b3c8f1-7419-4697-8546-a7b653be1de5)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Creating volume 7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:10 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:10 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c 1073741824 Nov 02 12:48:10 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:10 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:10 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa Nov 02 12:48:10 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:10 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4.9b9289c7-9c5f-4089-964d-c4f906d9a2aa" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-9b9289c7-9c5f-4089-964d-c4f906d9a2aa" released by "_delete_snapshot" :: held 1.696s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" released by "delete_snapshot" :: held 1.722s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:10 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c 1073741824" returned: 0 in 0.491s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['ca2613d1-1577-4891-b742-dfa84b35d4c4', '193cbb9f-3878-473a-9060-59a161a62d10', '29b06d40-efe0-464a-91d1-9780b32d4ea0', '3451ac5e-b7b8-4323-928d-9242ae381b92'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:10 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c Nov 02 12:48:10 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Delete snapshot completed successfully. Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cfb96034-3dbc-46ef-a550-1ad578b57099 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-9b9289c7-9c5f-4089-964d-c4f906d9a2aa-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:10 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb9aca5-43d6-46bc-ac81-9198dd01dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932fd071-255f-4031-a624-77914c474545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Volume volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c (7356b5e8-6cc7-43cd-a18f-badcf8eb203c): created successfully Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932fd071-255f-4031-a624-77914c474545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (002a4c15-3251-4d20-ae2d-f58d4536ad9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-650a44be-0306-463b-8305-cc940d97a8a1 tempest-GroupSnapshotsTest-5236120 None] Created volume successfully. Nov 02 12:48:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-353756e1-857f-4d5b-b741-3c8a17013547 tempest-GroupSnapshotsTest-5236120 None] Update group completed successfully. Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (d3a463b0-9cc5-49b2-ad04-4431255f9153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4ef8ed-d8b7-472d-b650-6cef71b2680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4ef8ed-d8b7-472d-b650-6cef71b2680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1952124451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bd37af-40e0-460b-8a09-64c6053d00ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:11Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bcf74e-2300-4ce3-9d21-8452ffbfa664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bcf74e-2300-4ce3-9d21-8452ffbfa664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290431eb-cf09-4ac9-9c42-6454df271a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290431eb-cf09-4ac9-9c42-6454df271a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bd37af-40e0-460b-8a09-64c6053d00ac', 'volume_name': 'volume-f3bd37af-40e0-460b-8a09-64c6053d00ac', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fc3015-7e53-4f15-a365-f0d0ff90b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fc3015-7e53-4f15-a365-f0d0ff90b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878d282-baa4-41e8-8a89-b6825975f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Volume f3bd37af-40e0-460b-8a09-64c6053d00ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bd37af-40e0-460b-8a09-64c6053d00ac', 'volume_size': 1} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1952124451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bd37af-40e0-460b-8a09-64c6053d00ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:11Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Creating volume f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:11 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac 1073741824 Nov 02 12:48:11 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:12 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac 1073741824" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:12 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:12 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:12 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878d282-baa4-41e8-8a89-b6825975f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bd37af-40e0-460b-8a09-64c6053d00ac', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a85ea7-3b66-4608-85f2-a813aa4275dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:12 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Volume volume-f3bd37af-40e0-460b-8a09-64c6053d00ac (f3bd37af-40e0-460b-8a09-64c6053d00ac): created successfully Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a85ea7-3b66-4608-85f2-a813aa4275dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (d3a463b0-9cc5-49b2-ad04-4431255f9153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9f009c89-6b29-47ea-a1cf-383fbc9da416 tempest-VolumesSnapshotTestJSON-613737112 None] Created volume successfully. Nov 02 12:48:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-15897776-d16c-463e-92a2-9362cf3cabf4 tempest-GroupSnapshotsTest-5236120 None] Update group completed successfully. Nov 02 12:48:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-16f0f336-bbb0-4557-8c54-7d6399940c01 tempest-GroupSnapshotsTest-5236120 None] Update group completed successfully. Nov 02 12:48:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Creating offline snapshot c3564460-cda3-4f3d-a699-d8934419f9c7 of volume f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4512d-9a20-4db6-83f4-05076b61b288]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:13 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:13 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:14 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:14 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 1G Nov 02 12:48:14 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:14 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 1G" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bd37af-40e0-460b-8a09-64c6053d00ac -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:14 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bd37af-40e0-460b-8a09-64c6053d00ac -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:14 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:15 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3bd37af-40e0-460b-8a09-64c6053d00ac -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.403s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 is being set with open permissions: ugo+rw Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:15 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:15 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7e0472db-a677-4e73-9491-5e0884890597 tempest-GroupSnapshotsTest-5236120 None] Update group completed successfully. Nov 02 12:48:15 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:15 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info Nov 02 12:48:15 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:15 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info is being set with open permissions: ugo+rw Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:15 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info Nov 02 12:48:15 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:15 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.info" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fbf8d5dd-74cc-40eb-baab-aa9b81af68d3 tempest-VolumesSnapshotTestJSON-613737112 None] Create snapshot completed successfully Nov 02 12:48:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] GroupSnapshot 13a71e90-528a-42b5-9838-69794a319174: creating. Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Group snapshot 13a71e90-528a-42b5-9838-69794a319174: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Creating offline snapshot 0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 of volume 7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96c7ea-ee18-453f-bfab-58d212c8e08e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:16 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c Nov 02 12:48:16 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:17 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:17 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 1G Nov 02 12:48:17 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (45a18bf7-3e16-4d8c-b97f-4902be283bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2a29c4-5e3e-45a1-9982-ca274593aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2a29c4-5e3e-45a1-9982-ca274593aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1872857952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55495776-80e9-4e75-aba5-48532e5df5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c3564460-cda3-4f3d-a699-d8934419f9c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:18Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8678de-e398-4867-89e5-90010694dcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8678de-e398-4867-89e5-90010694dcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06090ae9-79b1-478f-a227-507f64bf47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06090ae9-79b1-478f-a227-507f64bf47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55495776-80e9-4e75-aba5-48532e5df5b6', 'volume_name': 'volume-55495776-80e9-4e75-aba5-48532e5df5b6', 'volume_size': 2, 'snapshot_id': 'c3564460-cda3-4f3d-a699-d8934419f9c7'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fba4868-a0c7-48c8-a8ca-f5faa0b2eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fba4868-a0c7-48c8-a8ca-f5faa0b2eb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd4c81-5c62-4f64-94fc-71c81634895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Volume 55495776-80e9-4e75-aba5-48532e5df5b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55495776-80e9-4e75-aba5-48532e5df5b6', 'volume_size': 2, 'snapshot_id': 'c3564460-cda3-4f3d-a699-d8934419f9c7'} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:17 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 1G" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:17 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 Nov 02 12:48:17 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:18 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:18 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:18 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 Nov 02 12:48:18 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:18 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:18 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info Nov 02 12:48:18 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:18 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:18 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:18 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info Nov 02 12:48:18 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:18 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.info" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Creating offline snapshot bcb6a566-f36c-4f33-9d04-7efa1b80ac59 of volume 30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8333823-0264-48f8-bc46-fbcdf314102d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:19 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 Nov 02 12:48:19 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:19 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:19 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 1G Nov 02 12:48:19 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:19 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 1G" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:19 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 Nov 02 12:48:19 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:20 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:20 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 Nov 02 12:48:20 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:20 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:20 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info Nov 02 12:48:20 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:20 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:20 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:20 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info Nov 02 12:48:20 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:21 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.info" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.394s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7-55495776-80e9-4e75-aba5-48532e5df5b6" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7-55495776-80e9-4e75-aba5-48532e5df5b6" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Creating volume 55495776-80e9-4e75-aba5-48532e5df5b6 from snapshot c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] snapshot: c3564460-cda3-4f3d-a699-d8934419f9c7, volume: 55495776-80e9-4e75-aba5-48532e5df5b6, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d40a88d-f512-45e6-bca6-32cf2d29e123]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-178fb3bf-0864-494b-a070-6a8087075d1e tempest-GroupSnapshotsTest-5236120 None] group_snapshot 13a71e90-528a-42b5-9838-69794a319174: created successfully Nov 02 12:48:21 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:21 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:21 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.404s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bd37af-40e0-460b-8a09-64c6053d00ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97c015-c039-4258-96af-825f07d654f1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:21 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:21 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:22 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:22 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 Nov 02 12:48:22 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] group_snapshot 13a71e90-528a-42b5-9838-69794a319174: deleting Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] group_snapshot 13a71e90-528a-42b5-9838-69794a319174: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Deleting offline snapshot 0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 of volume 7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] snapshot_file for this snap is: volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[475dcb6d-c29e-4a19-b80a-4b3f28bef030]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:22 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 Nov 02 12:48:22 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:23 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" returned: 0 in 0.705s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87718ae0-04d3-4c00-a28b-ee0a7c1cb4e3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:23 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c Nov 02 12:48:23 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:24 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" returned: 0 in 0.976s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:24 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 Nov 02 12:48:24 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:24 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" returned: 0 in 0.704s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:24 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9 Nov 02 12:48:24 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:25 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c.0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" returned: 0 in 0.432s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-0306c9bd-282d-40ec-8d0c-31f2cfeb91c9" released by "_delete_snapshot" :: held 3.059s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" released by "delete_snapshot" :: held 3.106s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-bcb6a566-f36c-4f33-9d04-7efa1b80ac59" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-bcb6a566-f36c-4f33-9d04-7efa1b80ac59" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Deleting offline snapshot bcb6a566-f36c-4f33-9d04-7efa1b80ac59 of volume 30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] snapshot_file for this snap is: volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce7590-8363-4b12-a959-ff7940565328]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:25 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 Nov 02 12:48:25 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:26 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59" returned: 0 in 0.599s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba2802-20e8-4e23-b229-4c9f612a4953]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:26 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 Nov 02 12:48:26 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:26 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" returned: 0 in 0.767s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:27 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 Nov 02 12:48:27 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:27 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59" returned: 0 in 0.694s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:27 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59 Nov 02 12:48:27 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:28 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13.bcb6a566-f36c-4f33-9d04-7efa1b80ac59" returned: 0 in 0.422s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-bcb6a566-f36c-4f33-9d04-7efa1b80ac59" released by "_delete_snapshot" :: held 2.745s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" released by "delete_snapshot" :: held 2.783s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:28 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1740103081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1740103081, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:28 devstack cinder-volume[86731]: WARNING cinder.quota [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1740103081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1740103081, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['04d251a2-700f-42ed-b076-d4f10116bc4a', '0bf64ea0-3030-4a50-ae10-f8b0fc2f1042', 'd3eda58a-1608-41cc-9eb5-89e192606b28', '27ac6673-c3fa-4254-ac11-81564ffc2098'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['e54092f7-ca2c-42c1-a6bc-21cfc1028404', 'b6dd6cbb-9813-4c79-b62a-0e90a691881c', '6d1c0f87-ddc1-4c5f-b5ab-a401cd9ffd51', '58cf9758-ee33-4b75-bf79-d48cc830c31f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c116c86c-a161-4501-b64c-5fa1459149b8 tempest-GroupSnapshotsTest-5236120 None] group_snapshot 13a71e90-528a-42b5-9838-69794a319174: deleted successfully Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:29 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:29 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:29 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.568s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:48:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:48:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246987c-7c6c-45de-a2be-be9791c4b7f8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:30 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6" returned: 0 in 8.599s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac, size 1024.00 MB, duration 8.60 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:48:30 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Converted 1024.00 MB image at 119.03 MB/s Nov 02 12:48:30 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 is being set with open permissions: ugo+rw Nov 02 12:48:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:30 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 Nov 02 12:48:30 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:30 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 Nov 02 12:48:30 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:31 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" released by "_copy_volume_from_snapshot" :: held 9.848s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7-55495776-80e9-4e75-aba5-48532e5df5b6" released by "_create_volume_from_snapshot" :: held 9.928s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.952s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:31 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" returned: 0 in 0.513s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:31 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13 Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bd4c81-5c62-4f64-94fc-71c81634895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55495776-80e9-4e75-aba5-48532e5df5b6', 'volume_size': 2, 'snapshot_id': 'c3564460-cda3-4f3d-a699-d8934419f9c7'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:31 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a08d13-f1bc-4e6a-9405-783743aa7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Volume volume-55495776-80e9-4e75-aba5-48532e5df5b6 (55495776-80e9-4e75-aba5-48532e5df5b6): created successfully Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a08d13-f1bc-4e6a-9405-783743aa7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (45a18bf7-3e16-4d8c-b97f-4902be283bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b067ad1e-77ca-42b3-93a6-fb23a8ef0706 tempest-VolumesSnapshotTestJSON-613737112 None] Created volume successfully. Nov 02 12:48:31 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-30b78b15-fb42-4ab9-bc45-528ed8ce5b13" released by "delete_volume" :: held 1.015s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead21fc9-bce9-4b87-845a-3e7506faf8b5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:31 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c Nov 02 12:48:31 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:31 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:31 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c Nov 02 12:48:31 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-55495776-80e9-4e75-aba5-48532e5df5b6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-55495776-80e9-4e75-aba5-48532e5df5b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b022d4-fd14-4c8b-a3f3-d5ef7a4f7529]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:32 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" returned: 0 in 0.298s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-7356b5e8-6cc7-43cd-a18f-badcf8eb203c" released by "delete_volume" :: held 0.785s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:32 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 Nov 02 12:48:32 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['aa29e82d-97b0-4571-9cca-752f85b7630d'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:32 devstack cinder-volume[86731]: WARNING cinder.quota [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1740103081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1740103081, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['f2d5fc86-1e33-4f10-a491-f6f3400c75c2', '9914e82b-196e-471a-b977-f37f928940a8', 'a216c858-707b-456b-b0de-fd2a0d6cb9a7', '2760bd66-9a99-4053-a779-bf63018fbd88'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Created reservations ['6d5dc891-1279-4749-beab-eeeb3c30841b', '1581dec4-c932-459e-9fcc-1e20cd146db0', '809ccb73-081a-4a4a-812d-11490ba02e51', 'f30138b9-9368-4a5e-a9ca-22d191f87126'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:32 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:32 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6 Nov 02 12:48:32 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:32 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:32 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:32 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-55495776-80e9-4e75-aba5-48532e5df5b6" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-55495776-80e9-4e75-aba5-48532e5df5b6" released by "delete_volume" :: held 0.817s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:32 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['afe42912-8472-4688-b084-7891572045c2', 'ac2c0382-d916-4463-92f6-a23e007f9da1', '50410f0a-2a67-4d68-9a0a-248a5ebbfb6f', '8278e931-1045-4323-9eaa-01c58aa7cb40'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-afd6a234-7cdd-47e4-b2f3-83eddd038d59 tempest-GroupSnapshotsTest-5236120 None] Delete group completed successfully. Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:33 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:33 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:33 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Deleted volume successfully. Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a646a7ff-40e4-427c-a5c2-bd1d4628da3a tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-55495776-80e9-4e75-aba5-48532e5df5b6-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-c3564460-cda3-4f3d-a699-d8934419f9c7-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0d3bc889-1a65-49c4-8f57-d1abc689c1b3 tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-963675665: creating Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-c3564460-cda3-4f3d-a699-d8934419f9c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0d3bc889-1a65-49c4-8f57-d1abc689c1b3 tempest-GroupSnapshotsTest-5236120 None] Group tempest-GroupSnapshotsTest-Group-963675665: created successfully Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Deleting offline snapshot c3564460-cda3-4f3d-a699-d8934419f9c7 of volume f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] snapshot_file for this snap is: volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0d3bc889-1a65-49c4-8f57-d1abc689c1b3 tempest-GroupSnapshotsTest-5236120 None] Create group completed successfully. Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f39743-a00f-49e9-b921-0dac98241587]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:33 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:33 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:34 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3bd37af-40e0-460b-8a09-64c6053d00ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599939a-4380-4cbd-a67c-ce8b80497e49]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:34 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:34 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:34 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.565s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:34 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:34 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:35 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Flow 'volume_create_manager' (59576fcd-3d3d-407c-bd0b-9c3ca84c7650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf91a19-1caf-4051-aad6-e29f6e0b42f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf91a19-1caf-4051-aad6-e29f6e0b42f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-965279622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f12899637428d88bd12e9d3eacdfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:35Z,use_quota=True,user_id='20bfe2cc3ec1432ebb211222eb5ae063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4394281-43d1-4f0a-a66d-c512ed10846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4394281-43d1-4f0a-a66d-c512ed10846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7 Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802a4ca3-568c-42ca-8a2a-d3d8cfcfab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802a4ca3-568c-42ca-8a2a-d3d8cfcfab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5', 'volume_name': 'volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f079f860-adb0-4e0d-84fa-4092c7a213ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f079f860-adb0-4e0d-84fa-4092c7a213ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9acbd77-39e3-4373-b5bb-872f58624f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5', 'volume_size': 1} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-965279622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f12899637428d88bd12e9d3eacdfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:35Z,use_quota=True,user_id='20bfe2cc3ec1432ebb211222eb5ae063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Creating volume e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:35 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 1073741824 Nov 02 12:48:35 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (267c464f-62ce-47ff-9421-70936339dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7186a2f0-e014-40c3-a914-67ce9ba81a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7186a2f0-e014-40c3-a914-67ce9ba81a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695118679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aef00608-f957-4888-8043-7f29c2956d26,host='devstack@QuobyteHD#QuobyteHD',id=383d7642-1e14-42ce-8a05-824e30524a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:35Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c342b669-d412-432e-b640-df8ef4486aee),volume_type_id=c342b669-d412-432e-b640-df8ef4486aee)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20142d96-ec16-4ebe-8665-6031352b68ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20142d96-ec16-4ebe-8665-6031352b68ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744eae01-aa52-4598-882c-df49eee9b1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744eae01-aa52-4598-882c-df49eee9b1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383d7642-1e14-42ce-8a05-824e30524a16', 'volume_name': 'volume-383d7642-1e14-42ce-8a05-824e30524a16', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a31eaa-b26a-4c40-a565-2f15597b734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a31eaa-b26a-4c40-a565-2f15597b734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc368ee-e734-49f4-a032-4c3a1e8fc9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Volume 383d7642-1e14-42ce-8a05-824e30524a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383d7642-1e14-42ce-8a05-824e30524a16', 'volume_size': 1} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Flow 'volume_create_manager' (2d6b1d56-5934-44c8-866d-b5229d027f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:35 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5921c05-1a07-4dfb-b228-08900107f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac.c3564460-cda3-4f3d-a699-d8934419f9c7" returned: 0 in 0.449s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5921c05-1a07-4dfb-b228-08900107f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-775888314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc56678-4878-4c88-bda9-a15557321f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f12899637428d88bd12e9d3eacdfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:36Z,use_quota=True,user_id='20bfe2cc3ec1432ebb211222eb5ae063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b29eae2-a2d6-413c-9f85-f38352bcf664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b29eae2-a2d6-413c-9f85-f38352bcf664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb215e0-9772-4aa9-b7fc-406251af5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb215e0-9772-4aa9-b7fc-406251af5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc56678-4878-4c88-bda9-a15557321f4e', 'volume_name': 'volume-bdc56678-4878-4c88-bda9-a15557321f4e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df67cf85-d713-4e46-82e1-90ee3820bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df67cf85-d713-4e46-82e1-90ee3820bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1390238b-039d-47d4-9f7d-040a31323965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume bdc56678-4878-4c88-bda9-a15557321f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc56678-4878-4c88-bda9-a15557321f4e', 'volume_size': 1} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-c3564460-cda3-4f3d-a699-d8934419f9c7" released by "_delete_snapshot" :: held 2.160s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" released by "delete_snapshot" :: held 2.191s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['f7710e0b-d259-443d-80a0-9bdcd8bd594e', 'eb34a314-33d3-40c3-90d6-2fee84ffcc54', 'c71efcc1-e8e5-4ae6-8fb8-134a7e27a32e', '2c1fe4d3-d187-41a6-817b-edf99e747da3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:35 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 1073741824" returned: 0 in 0.595s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Delete snapshot completed successfully. Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f3a5ba6a-cc83-4002-9880-0297ab859ce1 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-c3564460-cda3-4f3d-a699-d8934419f9c7-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:35 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 Nov 02 12:48:35 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:36 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" returned: 0 in 0.244s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aef00608-f957-4888-8043-7f29c2956d26,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695118679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aef00608-f957-4888-8043-7f29c2956d26,host='devstack@QuobyteHD#QuobyteHD',id=383d7642-1e14-42ce-8a05-824e30524a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9c650ec53243f78beb3c75eb6b43ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:35Z,use_quota=True,user_id='112cdc1d689c46999c47432fed3e4965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c342b669-d412-432e-b640-df8ef4486aee),volume_type_id=c342b669-d412-432e-b640-df8ef4486aee)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Creating volume 383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:36 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 1073741824 Nov 02 12:48:36 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9acbd77-39e3-4373-b5bb-872f58624f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f55a580-77ae-4c58-a48d-22231a82b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 (e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5): created successfully Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f55a580-77ae-4c58-a48d-22231a82b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Flow 'volume_create_manager' (59576fcd-3d3d-407c-bd0b-9c3ca84c7650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5f15e075-befb-4f37-a5a1-8da90a0f5016 tempest-TestServerVolumeAttachmentScenario-807418242 None] Created volume successfully. Nov 02 12:48:36 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 1073741824" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:36 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 Nov 02 12:48:36 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:36 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-775888314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc56678-4878-4c88-bda9-a15557321f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='971f12899637428d88bd12e9d3eacdfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:36Z,use_quota=True,user_id='20bfe2cc3ec1432ebb211222eb5ae063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Creating volume bdc56678-4878-4c88-bda9-a15557321f4e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc368ee-e734-49f4-a032-4c3a1e8fc9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383d7642-1e14-42ce-8a05-824e30524a16', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:36 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e 1073741824 Nov 02 12:48:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabb1eee-205c-4728-a568-c1cadf2e80dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:36 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Volume volume-383d7642-1e14-42ce-8a05-824e30524a16 (383d7642-1e14-42ce-8a05-824e30524a16): created successfully Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabb1eee-205c-4728-a568-c1cadf2e80dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Flow 'volume_create_manager' (267c464f-62ce-47ff-9421-70936339dad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-747d6c37-cc50-4a78-b742-ad55cba928cd tempest-GroupSnapshotsTest-5236120 None] Created volume successfully. Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-f3bd37af-40e0-460b-8a09-64c6053d00ac-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-f3bd37af-40e0-460b-8a09-64c6053d00ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc29b6-d3af-4a0d-88f3-63e5a851be12]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:37 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:37 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:37 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e 1073741824" returned: 0 in 0.573s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:37 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e Nov 02 12:48:37 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:37 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:37 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac Nov 02 12:48:37 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] GroupSnapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: creating. Nov 02 12:48:37 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1390238b-039d-47d4-9f7d-040a31323965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc56678-4878-4c88-bda9-a15557321f4e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ffe65-0d70-4652-981a-43e2819ccf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Group snapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: creating. {{(pid=86731) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:48:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Volume volume-bdc56678-4878-4c88-bda9-a15557321f4e (bdc56678-4878-4c88-bda9-a15557321f4e): created successfully Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9ffe65-0d70-4652-981a-43e2819ccf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Flow 'volume_create_manager' (2d6b1d56-5934-44c8-866d-b5229d027f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5e3476f7-1fa6-4cfd-8179-73508e7882ba tempest-TestServerVolumeAttachmentScenario-807418242 None] Created volume successfully. Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Creating offline snapshot 42392dcf-a315-426e-bb6a-0d491d2854a4 of volume 383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e7c5e-e4dd-45d7-ad21-be98b731e0bb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:37 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f3bd37af-40e0-460b-8a09-64c6053d00ac" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-f3bd37af-40e0-460b-8a09-64c6053d00ac" released by "delete_volume" :: held 0.863s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['dea24324-fe59-42b6-a512-683c1056b413', 'b51e9e7f-6754-49db-8c3c-4a8a89c5914c', 'dfd9ccb8-fd06-485b-9369-7965f34cdce3', 'aa66efa3-5810-4b16-afb6-8e047c069358'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:38 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 Nov 02 12:48:38 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:38 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:38 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:38 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:38 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 1G Nov 02 12:48:38 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:38 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Deleted volume successfully. Nov 02 12:48:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d61880d7-b0b7-4430-bfa6-34585029f39c tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-f3bd37af-40e0-460b-8a09-64c6053d00ac-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (fd00b560-ea14-4dcf-8700-d8c2e810563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:39 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f75c479-bda3-447b-8e67-29cd267ef192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 1G" returned: 0 in 0.603s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383d7642-1e14-42ce-8a05-824e30524a16 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f75c479-bda3-447b-8e67-29cd267ef192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098218465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac185f-a7e5-4edc-8cba-bb1e9e5e4540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:39Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:39 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383d7642-1e14-42ce-8a05-824e30524a16 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 Nov 02 12:48:39 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2da403a-5293-4c57-bdfb-3003a4831a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2da403a-5293-4c57-bdfb-3003a4831a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a1dd-d2c0-4fcf-a731-561c58998a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc3a1dd-d2c0-4fcf-a731-561c58998a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcac185f-a7e5-4edc-8cba-bb1e9e5e4540', 'volume_name': 'volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d8e15-fc03-4f68-8dd4-46371d873aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d8e15-fc03-4f68-8dd4-46371d873aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a76ab49-b881-4638-a043-be23155e0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Volume bcac185f-a7e5-4edc-8cba-bb1e9e5e4540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540', 'volume_size': 1} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:39 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383d7642-1e14-42ce-8a05-824e30524a16 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:39 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 Nov 02 12:48:39 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:39 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:39 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info Nov 02 12:48:39 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:39 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:48:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:39 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info Nov 02 12:48:39 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:40 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.info" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098218465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac185f-a7e5-4edc-8cba-bb1e9e5e4540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:39Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Creating volume bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:40 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:40 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 1073741824 Nov 02 12:48:40 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3500e4c3-ac1f-4065-8108-19eb9caf89fe tempest-GroupSnapshotsTest-5236120 None] group_snapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: created successfully Nov 02 12:48:40 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 1073741824" returned: 0 in 0.517s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:40 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:48:40 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:41 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a76ab49-b881-4638-a043-be23155e0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50224494-1a1c-4fe3-b8ea-37ebe8024019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Volume volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 (bcac185f-a7e5-4edc-8cba-bb1e9e5e4540): created successfully Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50224494-1a1c-4fe3-b8ea-37ebe8024019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (fd00b560-ea14-4dcf-8700-d8c2e810563f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bce9ed1c-4bb6-4b64-ac62-182f1ed6cb3b tempest-VolumesSnapshotTestJSON-613737112 None] Created volume successfully. Nov 02 12:48:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] group_snapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: deleting Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] group_snapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: deleting {{(pid=86731) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-42392dcf-a315-426e-bb6a-0d491d2854a4" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-42392dcf-a315-426e-bb6a-0d491d2854a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Deleting offline snapshot 42392dcf-a315-426e-bb6a-0d491d2854a4 of volume 383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] snapshot_file for this snap is: volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dfcff3-1a2c-4ff4-bd2b-c111bae47956]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:41 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 Nov 02 12:48:41 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:41 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-383d7642-1e14-42ce-8a05-824e30524a16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea9acd-e74b-4160-baba-6544fe6721cb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:42 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 Nov 02 12:48:42 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:42 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:42 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 Nov 02 12:48:42 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Creating offline snapshot fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb of volume bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b9065c-e572-4b16-9c8d-c24df47eb905]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:42 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:48:42 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:42 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4" returned: 0 in 0.502s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:42 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4 Nov 02 12:48:42 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:43 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16.42392dcf-a315-426e-bb6a-0d491d2854a4" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:43 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.669s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-42392dcf-a315-426e-bb6a-0d491d2854a4" released by "_delete_snapshot" :: held 1.968s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" released by "delete_snapshot" :: held 2.012s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:43 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb 1G Nov 02 12:48:43 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:43 devstack cinder-volume[86731]: WARNING cinder.quota [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1367584074 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1367584074, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:43 devstack cinder-volume[86731]: WARNING cinder.quota [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1367584074 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1367584074, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] Created reservations ['e2b6600a-42c0-4887-a2b6-a2b599a9ae2a', '15343ce4-1950-4720-bbc3-fd8d5d3aa599', 'db53db5c-9ff5-40f6-b849-167db95a8e90', '39aae679-4388-4812-ab5c-4c87de3d99b1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5a80d952-038b-4814-8b14-8c197af27b9a tempest-GroupSnapshotsTest-5236120 None] group_snapshot 40368f19-6971-45b7-abe3-ee7f0856f7e0: deleted successfully Nov 02 12:48:44 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb 1G" returned: 0 in 0.837s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:44 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:48:44 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:44 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:44 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb is being set with open permissions: ugo+rw Nov 02 12:48:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:44 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:48:44 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:44 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.338s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:45 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info Nov 02 12:48:45 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=146,cinder:UPDATE=170,cinder:INSERT=41,cinder:DELETE=12 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc3ed12-c14c-4cc9-9b5f-291a4cb1c7ef]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:45 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:45 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info is being set with open permissions: ugo+rw Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:45 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info Nov 02 12:48:45 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:45 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 Nov 02 12:48:45 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:45 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.info" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.060s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6a8b92b8-61bd-43e1-b424-1c8b436755ce tempest-VolumesSnapshotTestJSON-613737112 None] Create snapshot completed successfully Nov 02 12:48:45 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:45 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16 Nov 02 12:48:45 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:46 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383d7642-1e14-42ce-8a05-824e30524a16" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Lock "cinder-quobyte-383d7642-1e14-42ce-8a05-824e30524a16" released by "delete_volume" :: held 1.030s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Created reservations ['b9c30be4-e8d3-4ada-9873-0259a9a201b5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:46 devstack cinder-volume[86731]: WARNING cinder.quota [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1367584074 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1367584074, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Created reservations ['e2bd6ffb-fa37-4e32-8832-77effaaa8720', '2cc08b95-c032-4620-9e7f-365088866b6e', 'b4a58b7c-0835-4e5a-96df-75e05508f50c', '36b0d1c9-c2f5-433e-a9c2-dfa1de6cf24a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:46 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:46 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (5dd30422-7893-4ed2-96c3-45ecb8206276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9928406c-0320-446c-8d04-a858b56ae18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9928406c-0320-446c-8d04-a858b56ae18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1597594085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5199874a-d3f0-4927-9b84-144f27561643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc998b9026654dfab0273a34c93350d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:48:47Z,use_quota=True,user_id='02f5041ff4614f6dbbc164a22a6e0c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d59dd4c-3959-430e-8a8d-d490d1b1b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d59dd4c-3959-430e-8a8d-d490d1b1b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56227f3-27e5-47bb-a80e-32f359499590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56227f3-27e5-47bb-a80e-32f359499590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5199874a-d3f0-4927-9b84-144f27561643', 'volume_name': 'volume-5199874a-d3f0-4927-9b84-144f27561643', 'volume_size': 1, 'snapshot_id': 'fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525acaa7-7045-4ff9-b8ca-1b5016855afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525acaa7-7045-4ff9-b8ca-1b5016855afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dca9dc-848e-4361-92bd-9ce52cb551bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Volume 5199874a-d3f0-4927-9b84-144f27561643: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5199874a-d3f0-4927-9b84-144f27561643', 'volume_size': 1, 'snapshot_id': 'fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb'} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-5199874a-d3f0-4927-9b84-144f27561643" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:47 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e430f44-6805-4e68-9c73-905f96e529da tempest-GroupSnapshotsTest-5236120 None] Delete group completed successfully. Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-5199874a-d3f0-4927-9b84-144f27561643" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Creating volume 5199874a-d3f0-4927-9b84-144f27561643 from snapshot fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] snapshot: fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb, volume: 5199874a-d3f0-4927-9b84-144f27561643, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a5f36-e931-4947-b3a8-acba01b58549]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:47 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:48:47 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:47 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201d882-6673-485b-93dd-044d1bb94895]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:47 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:48:47 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:48 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:48:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:48:48 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:48:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:48 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 Nov 02 12:48:48 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:56 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:INSERT=43,cinder:UPDATE=175,cinder:SELECT=180,cinder:DELETE=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:48:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=11,cinder:DELETE=1,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:48:57 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643" returned: 0 in 9.698s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:57 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:48:57 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Converted 1024.00 MB image at 105.57 MB/s Nov 02 12:48:57 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 is being set with open permissions: ugo+rw Nov 02 12:48:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:57 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 Nov 02 12:48:57 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:58 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" released by "_copy_volume_from_snapshot" :: held 10.970s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-5199874a-d3f0-4927-9b84-144f27561643" released by "_create_volume_from_snapshot" :: held 11.041s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.074s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dca9dc-848e-4361-92bd-9ce52cb551bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5199874a-d3f0-4927-9b84-144f27561643', 'volume_size': 1, 'snapshot_id': 'fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a19ece-d939-48ec-af05-67f2cfa7f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:48:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Volume volume-5199874a-d3f0-4927-9b84-144f27561643 (5199874a-d3f0-4927-9b84-144f27561643): created successfully Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a19ece-d939-48ec-af05-67f2cfa7f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Flow 'volume_create_manager' (5dd30422-7893-4ed2-96c3-45ecb8206276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:48:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9753ff48-bcff-4e78-943a-c7b48e12d46f tempest-VolumesSnapshotTestJSON-613737112 None] Created volume successfully. Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-5199874a-d3f0-4927-9b84-144f27561643-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-5199874a-d3f0-4927-9b84-144f27561643-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[352babeb-6da9-4ea9-97a4-93e71e89a95b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:58 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 Nov 02 12:48:58 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:58 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:58 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643 Nov 02 12:48:58 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:59 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5199874a-d3f0-4927-9b84-144f27561643" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-5199874a-d3f0-4927-9b84-144f27561643" released by "delete_volume" :: held 0.683s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['c9ca8f8b-f053-45ac-b984-e13d19a7b165', '95abe99d-01e4-4cba-bede-9fde63bdb3b1', '458b624b-6169-44dc-aeb0-4342c105ea5e', '8ce4899d-2969-4e9e-8c40-ae8dcc703f88'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:59 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:48:59 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:48:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6722fed0-7dd9-441a-883b-a5565de0076a tempest-GroupsTest-743824917 None] Group tempest-Group1-136286320: creating Nov 02 12:48:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6722fed0-7dd9-441a-883b-a5565de0076a tempest-GroupsTest-743824917 None] Group tempest-Group1-136286320: created successfully Nov 02 12:48:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6722fed0-7dd9-441a-883b-a5565de0076a tempest-GroupsTest-743824917 None] Create group completed successfully. Nov 02 12:48:59 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:48:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Deleted volume successfully. Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8a29dcd2-dac7-4b63-9bfd-0f1de9f62166 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-5199874a-d3f0-4927-9b84-144f27561643-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Deleting offline snapshot fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb of volume bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] snapshot_file for this snap is: volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7f7ff-2e4e-4e1f-9889-bccc7fadf882]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:48:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:48:59 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:48:59 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:00 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb048d2-eec7-457c-9acd-5636480aa337]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:00 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:49:00 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:00 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.565s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:00 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:49:00 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d6e6ad3c-114a-40fb-bfd9-5c99bfd1e45a tempest-GroupsTest-743824917 None] Group tempest-Group2-1410391890: creating Nov 02 12:49:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d6e6ad3c-114a-40fb-bfd9-5c99bfd1e45a tempest-GroupsTest-743824917 None] Group tempest-Group2-1410391890: created successfully Nov 02 12:49:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d6e6ad3c-114a-40fb-bfd9-5c99bfd1e45a tempest-GroupsTest-743824917 None] Create group completed successfully. Nov 02 12:49:00 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:00 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb Nov 02 12:49:00 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:01 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540.fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb" released by "_delete_snapshot" :: held 1.614s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" released by "delete_snapshot" :: held 1.640s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['2bc43634-124c-4fd8-9370-3faac40bbe0e', '941fc44c-672b-4d90-876f-855bc20e0531', '1062ade2-ffc4-49bb-9298-f1d55e82a854', 'bbd548b8-c485-44c3-8ce0-3728283d18fe'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Delete snapshot completed successfully. Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8fd41004-5085-46d0-ac98-62a157883111 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-fa8fcaf8-496f-4d85-a2c1-b3eb295f4cfb-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2a4307-dac3-4084-89d2-566212707f4d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:02 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:49:02 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:49:02 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (f972281d-c80e-4ba4-9ea0-f2148a7f648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ec6473-ec8f-44bf-8e6a-ea01c9a27e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.440s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:02 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540 Nov 02 12:49:02 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ec6473-ec8f-44bf-8e6a-ea01c9a27e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131769927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cd89f6b-4ef2-46b0-9159-2a6c33644556,host='devstack@QuobyteHD#QuobyteHD',id=9a1106d9-44c0-48b9-994a-57fa8786b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:02Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6157fac8-6604-41a0-a1af-db69594b897d),volume_type_id=6157fac8-6604-41a0-a1af-db69594b897d)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d3c8dc-c7de-4891-8076-95a917eb6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d3c8dc-c7de-4891-8076-95a917eb6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903e2f2e-6796-4802-a3c4-f88792a3f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903e2f2e-6796-4802-a3c4-f88792a3f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1106d9-44c0-48b9-994a-57fa8786b961', 'volume_name': 'volume-9a1106d9-44c0-48b9-994a-57fa8786b961', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab6a958-f448-4e6d-9001-bd3bb0d37d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab6a958-f448-4e6d-9001-bd3bb0d37d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966e787-d666-403b-b622-23b1ffdc681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:02 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Volume 9a1106d9-44c0-48b9-994a-57fa8786b961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1106d9-44c0-48b9-994a-57fa8786b961', 'volume_size': 1} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1cd89f6b-4ef2-46b0-9159-2a6c33644556,created_at=2026-11-02T11:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131769927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cd89f6b-4ef2-46b0-9159-2a6c33644556,host='devstack@QuobyteHD#QuobyteHD',id=9a1106d9-44c0-48b9-994a-57fa8786b961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:02Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6157fac8-6604-41a0-a1af-db69594b897d),volume_type_id=6157fac8-6604-41a0-a1af-db69594b897d)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Creating volume 9a1106d9-44c0-48b9-994a-57fa8786b961 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:49:02 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:02 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 1073741824 Nov 02 12:49:02 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:02 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540" released by "delete_volume" :: held 0.772s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['a1daabfc-1097-42f5-9510-05a4f2cd11b5', '76033dc1-1e30-4e23-8504-3667365c5ae1', '1b5664f2-d44f-460f-a4e7-8090f6231364', '4882e120-2609-41b7-9d29-5372ba5140f1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:02 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:02 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:02 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 1073741824" returned: 0 in 0.461s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:03 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 Nov 02 12:49:03 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-062f7c1c-855e-44cb-9354-9cbfab2d9dd4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:03 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Deleted volume successfully. Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-062f7c1c-855e-44cb-9354-9cbfab2d9dd4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-bf3fc599-8a1b-47cf-8693-194068780e40 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-bcac185f-a7e5-4edc-8cba-bb1e9e5e4540-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[900601ac-0e27-4d95-9d54-f69031b85142]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:03 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966e787-d666-403b-b622-23b1ffdc681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1106d9-44c0-48b9-994a-57fa8786b961', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256dbce-9933-4285-b189-1e20a8522a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Volume volume-9a1106d9-44c0-48b9-994a-57fa8786b961 (9a1106d9-44c0-48b9-994a-57fa8786b961): created successfully Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d256dbce-9933-4285-b189-1e20a8522a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (f972281d-c80e-4ba4-9ea0-f2148a7f648c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-781dbbe0-a70c-4b4c-9cfb-14f3f4437ff0 tempest-GroupsTest-743824917 None] Created volume successfully. Nov 02 12:49:03 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 Nov 02 12:49:03 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:03 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" returned: 0 in 0.404s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:03 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4 Nov 02 12:49:03 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:03 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-quobyte-062f7c1c-855e-44cb-9354-9cbfab2d9dd4" released by "delete_volume" :: held 0.771s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Created reservations ['c38ad5b0-aef7-4acc-80ee-8f96cd3666e8', '5da03021-96c4-4669-b18e-c39d67e42223', '2e4f79b4-1924-4dd0-a37c-9175d596bb6a', 'e019622c-ed6f-4a9d-88b6-c49624ee935c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:04 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:04 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Acquiring lock "cinder-quobyte-9a1106d9-44c0-48b9-994a-57fa8786b961" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-9a1106d9-44c0-48b9-994a-57fa8786b961" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fbdb40-5ebd-4d65-a427-d368ac3e3a4f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:04 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.328s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Deleted volume successfully. Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b4c60ec9-50e3-44ca-8537-b4b74c74caa2 tempest-VolumesSnapshotTestJSON-613737112 None] Lock "cinder-062f7c1c-855e-44cb-9354-9cbfab2d9dd4-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:04 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 Nov 02 12:49:04 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:04 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:04 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961 Nov 02 12:49:04 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:05 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9a1106d9-44c0-48b9-994a-57fa8786b961" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-9a1106d9-44c0-48b9-994a-57fa8786b961" released by "delete_volume" :: held 0.894s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Created reservations ['efb50eae-02db-4f84-afb7-ef19eca9cc68'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:05 devstack cinder-volume[86731]: WARNING cinder.quota [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1100540265 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1100540265, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:49:05 devstack cinder-volume[86731]: WARNING cinder.quota [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1100540265 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1100540265, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Created reservations ['a8ff7b70-4a3c-4fc8-b95e-d798687bc423', '1adda005-d45b-43cf-807c-eb2fb5d4d53e', '525a6662-6219-4e88-837c-9c56e30cba12', '8ca2ae68-2d27-46f5-9405-b46056ca7d77'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:05 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:05 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Created reservations ['4b3b8efd-f167-43d1-91bd-fbcba4e85050'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:05 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.354s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-133f31b2-e1b1-47db-a557-42e04c9e2b33 tempest-GroupsTest-743824917 None] Delete group completed successfully. Nov 02 12:49:05 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:05 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:06 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.314s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:06 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2f392bba-1997-4b05-805f-f018cd1889d4 tempest-GroupsTest-743824917 None] Delete group completed successfully. Nov 02 12:49:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df9f311a-e97c-47f2-a92e-ac307b796064 tempest-GroupsTest-743824917 None] Group tempest-GroupsTest-Group-1471779498: creating Nov 02 12:49:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df9f311a-e97c-47f2-a92e-ac307b796064 tempest-GroupsTest-743824917 None] Group tempest-GroupsTest-Group-1471779498: created successfully Nov 02 12:49:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df9f311a-e97c-47f2-a92e-ac307b796064 tempest-GroupsTest-743824917 None] Create group completed successfully. Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (21bb23f8-3f34-4121-8d8c-f829261b042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d769b94-e9d0-4017-a4d1-44c157be6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d769b94-e9d0-4017-a4d1-44c157be6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1798398658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fd9162d-e5b1-4921-b343-dffabb481388,host='devstack@QuobyteHD#QuobyteHD',id=c31c10f4-5972-4558-8b4a-028c6c247d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:09Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cda671ff-72b6-4b8f-a53d-087eb4151d4b),volume_type_id=cda671ff-72b6-4b8f-a53d-087eb4151d4b)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f02d7a-cee3-49e2-9246-9ba14ad0c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f02d7a-cee3-49e2-9246-9ba14ad0c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f5b067-ee38-4007-8ff9-2059b3e2dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f5b067-ee38-4007-8ff9-2059b3e2dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31c10f4-5972-4558-8b4a-028c6c247d28', 'volume_name': 'volume-c31c10f4-5972-4558-8b4a-028c6c247d28', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a03b336-96d0-427b-8efa-ef552ce6b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a03b336-96d0-427b-8efa-ef552ce6b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fc1963-fcab-4163-bb6c-3a8e8559ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Volume c31c10f4-5972-4558-8b4a-028c6c247d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31c10f4-5972-4558-8b4a-028c6c247d28', 'volume_size': 1} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fd9162d-e5b1-4921-b343-dffabb481388,created_at=2026-11-02T11:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1798398658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fd9162d-e5b1-4921-b343-dffabb481388,host='devstack@QuobyteHD#QuobyteHD',id=c31c10f4-5972-4558-8b4a-028c6c247d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:09Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cda671ff-72b6-4b8f-a53d-087eb4151d4b),volume_type_id=cda671ff-72b6-4b8f-a53d-087eb4151d4b)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Creating volume c31c10f4-5972-4558-8b4a-028c6c247d28 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:49:09 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:09 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 1073741824 Nov 02 12:49:09 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3d7f294-2cc9-447e-85d4-710d23ba9cd0 req-9de33962-3fee-4d9c-a3f9-db4e6faa2089 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:09 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 1073741824" returned: 0 in 0.564s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:09 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 Nov 02 12:49:09 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:10 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3d7f294-2cc9-447e-85d4-710d23ba9cd0 req-9de33962-3fee-4d9c-a3f9-db4e6faa2089 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.452s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fc1963-fcab-4163-bb6c-3a8e8559ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31c10f4-5972-4558-8b4a-028c6c247d28', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9af71f-139a-422c-8029-7128bc07eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-d3d7f294-2cc9-447e-85d4-710d23ba9cd0 req-9de33962-3fee-4d9c-a3f9-db4e6faa2089 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Volume volume-c31c10f4-5972-4558-8b4a-028c6c247d28 (c31c10f4-5972-4558-8b4a-028c6c247d28): created successfully Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9af71f-139a-422c-8029-7128bc07eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (21bb23f8-3f34-4121-8d8c-f829261b042a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-bc67bbeb-6315-4925-85a5-c37f7217b871 tempest-GroupsTest-743824917 None] Created volume successfully. Nov 02 12:49:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-d3d7f294-2cc9-447e-85d4-710d23ba9cd0 req-9de33962-3fee-4d9c-a3f9-db4e6faa2089 tempest-TestServerVolumeAttachmentScenario-807418242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef534d52-5ca6-43dd-a191-0795b4d00234', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:49:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-d3d7f294-2cc9-447e-85d4-710d23ba9cd0 req-9de33962-3fee-4d9c-a3f9-db4e6faa2089 tempest-TestServerVolumeAttachmentScenario-807418242 None] attachment_update completed successfully. Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (4c884e0b-39ec-4807-928f-38133241ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e6d0e8-55f7-4434-b31c-7eb03704f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e6d0e8-55f7-4434-b31c-7eb03704f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060199697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fd9162d-e5b1-4921-b343-dffabb481388,host='devstack@QuobyteHD#QuobyteHD',id=89ba9aae-cd8e-43a2-9b48-21b47cd05289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:11Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cda671ff-72b6-4b8f-a53d-087eb4151d4b),volume_type_id=cda671ff-72b6-4b8f-a53d-087eb4151d4b)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbb3478-f936-46db-af23-01e4d062140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbb3478-f936-46db-af23-01e4d062140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7f2b89-6f14-4844-a51c-27b47239fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7f2b89-6f14-4844-a51c-27b47239fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ba9aae-cd8e-43a2-9b48-21b47cd05289', 'volume_name': 'volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb5edd3-f6cb-4a9e-ac1e-4657ef2bf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb5edd3-f6cb-4a9e-ac1e-4657ef2bf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f5be5-49a1-4008-aabd-936ed187bfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Volume 89ba9aae-cd8e-43a2-9b48-21b47cd05289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289', 'volume_size': 1} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fd9162d-e5b1-4921-b343-dffabb481388,created_at=2026-11-02T11:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1060199697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fd9162d-e5b1-4921-b343-dffabb481388,host='devstack@QuobyteHD#QuobyteHD',id=89ba9aae-cd8e-43a2-9b48-21b47cd05289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d5ce4dbfc4f08bf3cf081a06d0c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:11Z,use_quota=True,user_id='c71bdbaa920a4ebc83bd8e7569011cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cda671ff-72b6-4b8f-a53d-087eb4151d4b),volume_type_id=cda671ff-72b6-4b8f-a53d-087eb4151d4b)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Creating volume 89ba9aae-cd8e-43a2-9b48-21b47cd05289 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:49:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:11 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 1073741824 Nov 02 12:49:11 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:11 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 1073741824" returned: 0 in 0.524s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:11 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 Nov 02 12:49:11 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:12 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f5be5-49a1-4008-aabd-936ed187bfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c8513-40f8-41cd-8ab3-4b15a2ad7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:12 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Volume volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 (89ba9aae-cd8e-43a2-9b48-21b47cd05289): created successfully Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033c8513-40f8-41cd-8ab3-4b15a2ad7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Flow 'volume_create_manager' (4c884e0b-39ec-4807-928f-38133241ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8a3921e2-9b5b-4433-a8a0-e376a27f1e86 tempest-GroupsTest-743824917 None] Created volume successfully. Nov 02 12:49:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9ec4292e-6c2b-40f6-8860-29596ef94909 tempest-GroupsTest-743824917 None] Update group completed successfully. Nov 02 12:49:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6309578-304a-4141-a12c-632a9d189e7b tempest-GroupsTest-743824917 None] Update group completed successfully. Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Acquiring lock "cinder-quobyte-89ba9aae-cd8e-43a2-9b48-21b47cd05289" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-89ba9aae-cd8e-43a2-9b48-21b47cd05289" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fdaa05-c5e7-4670-bf05-fa53be242490]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3c5431fb-99c8-4292-b85f-e314cb8c3072 req-8edd0571-630c-44b6-9a89-0a2976872403 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3c5431fb-99c8-4292-b85f-e314cb8c3072 req-8edd0571-630c-44b6-9a89-0a2976872403 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-3c5431fb-99c8-4292-b85f-e314cb8c3072 req-8edd0571-630c-44b6-9a89-0a2976872403 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-3c5431fb-99c8-4292-b85f-e314cb8c3072 req-8edd0571-630c-44b6-9a89-0a2976872403 tempest-TestServerVolumeAttachmentScenario-807418242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-bdc56678-4878-4c88-bda9-a15557321f4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ffae3ac-cd20-40b1-b8c1-2ee965091b63', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:49:15 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 Nov 02 12:49:15 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-3c5431fb-99c8-4292-b85f-e314cb8c3072 req-8edd0571-630c-44b6-9a89-0a2976872403 tempest-TestServerVolumeAttachmentScenario-807418242 None] attachment_update completed successfully. Nov 02 12:49:15 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:15 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289 Nov 02 12:49:15 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:15 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-89ba9aae-cd8e-43a2-9b48-21b47cd05289" returned: 0 in 0.354s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-89ba9aae-cd8e-43a2-9b48-21b47cd05289" released by "delete_volume" :: held 0.866s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Acquiring lock "cinder-quobyte-c31c10f4-5972-4558-8b4a-028c6c247d28" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-c31c10f4-5972-4558-8b4a-028c6c247d28" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6870cd7a-ec70-4882-b503-b35dc587597c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:15 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 Nov 02 12:49:15 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:16 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:16 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28 Nov 02 12:49:16 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:16 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c31c10f4-5972-4558-8b4a-028c6c247d28" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "cinder-quobyte-c31c10f4-5972-4558-8b4a-028c6c247d28" released by "delete_volume" :: held 0.733s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Created reservations ['e9d00638-3cc3-4e11-a78c-a7306b225128'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:16 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1141772028 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1141772028, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:49:16 devstack cinder-volume[86731]: WARNING cinder.quota [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1141772028 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1141772028, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Created reservations ['ff155d9a-76b8-48fa-8b36-2a1f1aaa9100', '0f006568-769d-403e-b56d-cd7c65b3f36a', '41493d2f-8372-41d2-b71b-969baf340147', 'cef24f6c-1fde-4b8d-ad88-c8d49ac1641b'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Created reservations ['77aa28b2-3297-49af-a237-fd3b6d676891', '11ff5d00-da76-4cc2-85c4-03b1a774fad5', 'ef841fb7-3d98-47fe-9afa-1dc51a7777cc', '4453054a-401c-4ad6-9a84-2fb309a3e1f2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:16 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:16 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:17 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:17 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ac6828e0-7d04-4553-b5c8-a7b5f5db9276 tempest-GroupsTest-743824917 None] Delete group completed successfully. Nov 02 12:49:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-1776cd14-77af-45e9-83ce-16a2577251c5 req-f0e6d3d9-78b4-4bb2-a687-c5b770e276a9 tempest-TestServerVolumeAttachmentScenario-807418242 None] Terminate volume connection completed successfully. Nov 02 12:49:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-1776cd14-77af-45e9-83ce-16a2577251c5 req-f0e6d3d9-78b4-4bb2-a687-c5b770e276a9 tempest-TestServerVolumeAttachmentScenario-807418242 None] Deleting attachment 4ffae3ac-cd20-40b1-b8c1-2ee965091b63. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:49:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-92c8acd0-231b-4f97-ad61-7747835b4e5c req-d9c97c73-f195-4ae2-97ca-4231864560e2 tempest-TestServerVolumeAttachmentScenario-807418242 None] Terminate volume connection completed successfully. Nov 02 12:49:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-92c8acd0-231b-4f97-ad61-7747835b4e5c req-d9c97c73-f195-4ae2-97ca-4231864560e2 tempest-TestServerVolumeAttachmentScenario-807418242 None] Deleting attachment ef534d52-5ca6-43dd-a191-0795b4d00234. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "cinder-bdc56678-4878-4c88-bda9-a15557321f4e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-bdc56678-4878-4c88-bda9-a15557321f4e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "cinder-quobyte-bdc56678-4878-4c88-bda9-a15557321f4e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-quobyte-bdc56678-4878-4c88-bda9-a15557321f4e" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b2398b-9439-4f58-b258-fa1f3797bcb8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:24 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e Nov 02 12:49:24 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:24 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:24 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e Nov 02 12:49:24 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:24 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-bdc56678-4878-4c88-bda9-a15557321f4e" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-quobyte-bdc56678-4878-4c88-bda9-a15557321f4e" released by "delete_volume" :: held 0.722s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Created reservations ['a20e3722-348a-408a-a1b6-315f35b8cafc', '9d840c28-00fb-454e-af35-3c7497d3f068', '19e59443-b33b-4037-806f-c88ab82e02e7', '0b3f6573-ff1f-47d4-a33a-804520254437'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:25 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:25 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "cinder-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:25 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:25 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Deleted volume successfully. Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0042612e-3eea-40f5-8a2e-75c5b20b9fca tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-bdc56678-4878-4c88-bda9-a15557321f4e-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "cinder-quobyte-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-quobyte-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a804ef-0406-4454-83d2-063dc091e9ab]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:25 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 Nov 02 12:49:25 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:25 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:25 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5 Nov 02 12:49:25 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:26 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-quobyte-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5" released by "delete_volume" :: held 0.708s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Created reservations ['0492a622-4131-4349-a90c-721667a18cec', '002d3cef-98bb-430e-b86a-dc185dc52cce', 'a7da4e5a-9212-4bba-ad37-67b9cd1596d6', '4a9ec753-712e-4145-851d-c91b2e55407f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:26 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:26 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:26 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Deleted volume successfully. Nov 02 12:49:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ffb7766f-e6b6-4506-9c5d-db8954fd4614 tempest-TestServerVolumeAttachmentScenario-807418242 None] Lock "cinder-e4bb95a7-7f5b-4f7c-9370-a5a11034ebd5-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:28 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:49:28 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:29 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.270s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:49:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:49:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:49:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:49:36 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=85,cinder:SELECT=95,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:49:36 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=81,cinder:INSERT=17,cinder:UPDATE=108,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Flow 'volume_create_manager' (03959a58-1af1-41ea-9333-a0253240f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d453a-1c0a-45f2-802a-b958459bf962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d453a-1c0a-45f2-802a-b958459bf962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1282276627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c138c4-67fb-4b18-b506-0898eae87bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819f1875e71a4dc58406fa76ee248e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:59Z,use_quota=True,user_id='eaf4aea5e55940e8bc2c8a7bc7cd2b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ced440-2a8b-44ac-8ca7-4651a5464bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ced440-2a8b-44ac-8ca7-4651a5464bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1754e36-0c98-42f7-bb3b-5dc2ff673549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1754e36-0c98-42f7-bb3b-5dc2ff673549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c138c4-67fb-4b18-b506-0898eae87bcd', 'volume_name': 'volume-07c138c4-67fb-4b18-b506-0898eae87bcd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e05df3-538d-41c4-ae51-e327a7c4dca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e05df3-538d-41c4-ae51-e327a7c4dca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5acdde4-df05-4776-9fa6-3ade7d5c6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Volume 07c138c4-67fb-4b18-b506-0898eae87bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c138c4-67fb-4b18-b506-0898eae87bcd', 'volume_size': 1} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1282276627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c138c4-67fb-4b18-b506-0898eae87bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819f1875e71a4dc58406fa76ee248e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:49:59Z,use_quota=True,user_id='eaf4aea5e55940e8bc2c8a7bc7cd2b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Creating volume 07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:49:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:49:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:59 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd 1073741824 Nov 02 12:49:59 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:59 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd 1073741824" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:49:59 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:49:59 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:49:59 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5acdde4-df05-4776-9fa6-3ade7d5c6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c138c4-67fb-4b18-b506-0898eae87bcd', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab770653-be73-4373-9a01-2551eaa92b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:49:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Volume volume-07c138c4-67fb-4b18-b506-0898eae87bcd (07c138c4-67fb-4b18-b506-0898eae87bcd): created successfully Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab770653-be73-4373-9a01-2551eaa92b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:49:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Flow 'volume_create_manager' (03959a58-1af1-41ea-9333-a0253240f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:49:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b2725ee5-3bfd-45dc-8b32-76e0c99fe9f9 tempest-TestImageHashVerification-464353802 None] Created volume successfully. Nov 02 12:50:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3897af-99de-409d-a679-21a97ea85806]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:02 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:50:02 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:02 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:02 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7217e2-a0bd-41ae-a821-23480c42c1a2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:02 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:50:02 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:02 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd /opt/stack/data/cinder/conversion/07c138c4-67fb-4b18-b506-0898eae87bcd.temp_image.0e021b4d-084a-43ec-ae54-c3aa31831542iiz2p1_2.img {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:02 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd /opt/stack/data/cinder/conversion/07c138c4-67fb-4b18-b506-0898eae87bcd.temp_image.0e021b4d-084a-43ec-ae54-c3aa31831542iiz2p1_2.img Nov 02 12:50:02 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:09 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:50:09 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd /opt/stack/data/cinder/conversion/07c138c4-67fb-4b18-b506-0898eae87bcd.temp_image.0e021b4d-084a-43ec-ae54-c3aa31831542iiz2p1_2.img" returned: 0 in 7.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfec2009-8dd3-4202-be48-aaa5cb151978]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:10 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:50:10 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:10 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.579s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:10 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/conversion/07c138c4-67fb-4b18-b506-0898eae87bcd.temp_image.0e021b4d-084a-43ec-ae54-c3aa31831542iiz2p1_2.img {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:50:10 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Converted 1024.00 MB image at 141.28 MB/s Nov 02 12:50:10 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] 0e021b4d-084a-43ec-ae54-c3aa31831542 was raw, no need to convert to raw {{(pid=86731) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1192}} Nov 02 12:50:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:50:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (8f22a1b7-f816-4275-83c7-ad20f0be4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c7d630-f853-4e89-8c21-0cd710c06258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c7d630-f853-4e89-8c21-0cd710c06258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394294090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e96103-0865-4c70-a83f-41d3358c34c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:26Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd627fb3-3204-4dce-8b68-d8e7743a8432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd627fb3-3204-4dce-8b68-d8e7743a8432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6573dfb2-19f9-4e09-8d08-67ecf145d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6573dfb2-19f9-4e09-8d08-67ecf145d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e96103-0865-4c70-a83f-41d3358c34c2', 'volume_name': 'volume-a0e96103-0865-4c70-a83f-41d3358c34c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259814a-48fe-4514-9064-1508239abcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259814a-48fe-4514-9064-1508239abcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94880d04-94ba-4ee1-a559-7d3a8bd2b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:25 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Volume a0e96103-0865-4c70-a83f-41d3358c34c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e96103-0865-4c70-a83f-41d3358c34c2', 'volume_size': 1} Nov 02 12:50:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:29 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:29 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:29 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.455s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:50:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:50:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.482s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Uploaded volume to glance image-id: 0e021b4d-084a-43ec-ae54-c3aa31831542. {{(pid=86731) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.532s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394294090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e96103-0865-4c70-a83f-41d3358c34c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:26Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Creating volume a0e96103-0865-4c70-a83f-41d3358c34c2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:32 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 1073741824 Nov 02 12:50:32 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2ccb01d2-95e1-45ab-8de1-0bfd0e4c378d tempest-TestImageHashVerification-464353802 None] Copy volume to image completed successfully. Nov 02 12:50:32 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 1073741824" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:32 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 Nov 02 12:50:32 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:33 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2" returned: 0 in 0.237s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94880d04-94ba-4ee1-a559-7d3a8bd2b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e96103-0865-4c70-a83f-41d3358c34c2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51fb0ae-1a40-4810-ba08-7675d23fb26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Volume volume-a0e96103-0865-4c70-a83f-41d3358c34c2 (a0e96103-0865-4c70-a83f-41d3358c34c2): created successfully Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51fb0ae-1a40-4810-ba08-7675d23fb26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (8f22a1b7-f816-4275-83c7-ad20f0be4c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-87ae3859-5c2a-44b4-ac69-860f89e40152 tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-03e19d6b-e7d3-41a8-8a94-dddbf762327f tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2" by "attach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-03e19d6b-e7d3-41a8-8a94-dddbf762327f tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2" acquired by "attach_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-03e19d6b-e7d3-41a8-8a94-dddbf762327f tempest-VolumesActionsTest-1521032708 None] Attaching volume a0e96103-0865-4c70-a83f-41d3358c34c2 to instance 5abe3437-3a4b-4a76-a474-69d599e0eedc at mountpoint /dev/vdb on host None. Nov 02 12:50:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-03e19d6b-e7d3-41a8-8a94-dddbf762327f tempest-VolumesActionsTest-1521032708 None] Attach volume completed successfully. Nov 02 12:50:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-03e19d6b-e7d3-41a8-8a94-dddbf762327f tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2" released by "attach_volume" :: held 0.124s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Acquiring lock "cinder-07c138c4-67fb-4b18-b506-0898eae87bcd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "cinder-07c138c4-67fb-4b18-b506-0898eae87bcd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Acquiring lock "cinder-quobyte-07c138c4-67fb-4b18-b506-0898eae87bcd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "cinder-quobyte-07c138c4-67fb-4b18-b506-0898eae87bcd" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd2a48-8ffb-47ec-b043-d1cb9b7a23d4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:34 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:50:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Terminate volume connection completed successfully. Nov 02 12:50:34 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Detaching volume a0e96103-0865-4c70-a83f-41d3358c34c2 from instance 5abe3437-3a4b-4a76-a474-69d599e0eedc. Nov 02 12:50:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Detach volume completed successfully. Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f16065e5-41dd-4977-a78f-51dd364adf90 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:34 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7fcbe63-3b82-4089-b4fb-b1d510936da9 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" by "detach_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd Nov 02 12:50:34 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7fcbe63-3b82-4089-b4fb-b1d510936da9 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e7fcbe63-3b82-4089-b4fb-b1d510936da9 tempest-VolumesActionsTest-1521032708 None] Volume detach called, but volume not attached. Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e7fcbe63-3b82-4089-b4fb-b1d510936da9 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:34 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-07c138c4-67fb-4b18-b506-0898eae87bcd" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "cinder-quobyte-07c138c4-67fb-4b18-b506-0898eae87bcd" released by "delete_volume" :: held 0.753s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-quobyte-a0e96103-0865-4c70-a83f-41d3358c34c2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Created reservations ['5244ecb7-19ac-4a36-9480-fbde0574c328', '4e569cab-fbe5-4c35-b517-ada74874cce2', 'ce0d0126-44f3-4493-a269-4d2799c9161f', '77c11040-3ca1-4e38-821f-579f93c7d8cf'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-quobyte-a0e96103-0865-4c70-a83f-41d3358c34c2" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8bbed-f52a-4e6a-a235-fe4120781a34]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:35 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:35 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:35 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 Nov 02 12:50:35 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:35 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Deleted volume successfully. Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-06a6fe3c-5e09-4107-8d91-b37c0ef03412 tempest-TestImageHashVerification-464353802 None] Lock "cinder-07c138c4-67fb-4b18-b506-0898eae87bcd-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:35 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2" returned: 0 in 0.451s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:35 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2 Nov 02 12:50:35 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:35 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a0e96103-0865-4c70-a83f-41d3358c34c2" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-quobyte-a0e96103-0865-4c70-a83f-41d3358c34c2" released by "delete_volume" :: held 0.759s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Created reservations ['fb5d4751-fea7-4ed3-aa08-5c1c1f9fbf1c', '0b9e619f-ace2-4152-bbf5-fbb6f1487aab', 'b3e7d863-11d7-4084-92ed-c995180937e7', '7c73af8b-8577-4e69-bb47-338ac0b0d114'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:35 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:35 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:36 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:36 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Deleted volume successfully. Nov 02 12:50:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-07212041-bd00-4428-9fc5-cf4b2b87cbd2 tempest-VolumesActionsTest-1521032708 None] Lock "cinder-a0e96103-0865-4c70-a83f-41d3358c34c2-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (927428d9-6240-410c-992e-bd9ec3f3c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b7ce8-27a6-42be-addc-ffa13e598ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570b7ce8-27a6-42be-addc-ffa13e598ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-665642496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f32d49-4137-4479-95f2-dc7f3c99cde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:39Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643f4825-ad97-46d8-a23c-26ee088fa5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643f4825-ad97-46d8-a23c-26ee088fa5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081d6790-541f-4fc4-96da-412658f95fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081d6790-541f-4fc4-96da-412658f95fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f32d49-4137-4479-95f2-dc7f3c99cde1', 'volume_name': 'volume-87f32d49-4137-4479-95f2-dc7f3c99cde1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81945da-47c8-4521-8e17-82e6da0fa88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81945da-47c8-4521-8e17-82e6da0fa88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01da5d93-6d58-4004-b569-1aad42349aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Volume 87f32d49-4137-4479-95f2-dc7f3c99cde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f32d49-4137-4479-95f2-dc7f3c99cde1', 'volume_size': 1} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-665642496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f32d49-4137-4479-95f2-dc7f3c99cde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:39Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Creating volume 87f32d49-4137-4479-95f2-dc7f3c99cde1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:39 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:39 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 1073741824 Nov 02 12:50:39 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:40 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 1073741824" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:40 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 Nov 02 12:50:40 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:40 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01da5d93-6d58-4004-b569-1aad42349aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f32d49-4137-4479-95f2-dc7f3c99cde1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cd24c0-c67d-4811-998f-ad65877938d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Volume volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 (87f32d49-4137-4479-95f2-dc7f3c99cde1): created successfully Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cd24c0-c67d-4811-998f-ad65877938d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (927428d9-6240-410c-992e-bd9ec3f3c24f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-42ee3a1d-e864-4b49-8af6-ae7dd00f55b6 tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-87f32d49-4137-4479-95f2-dc7f3c99cde1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-87f32d49-4137-4479-95f2-dc7f3c99cde1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-quobyte-87f32d49-4137-4479-95f2-dc7f3c99cde1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-87f32d49-4137-4479-95f2-dc7f3c99cde1" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78205ad1-217e-43c9-8f13-c1f014b26364]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:41 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 Nov 02 12:50:41 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:42 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:42 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1 Nov 02 12:50:42 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:42 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-87f32d49-4137-4479-95f2-dc7f3c99cde1" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-87f32d49-4137-4479-95f2-dc7f3c99cde1" released by "delete_volume" :: held 0.679s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Created reservations ['3e077d12-0421-4890-ad15-0e10c7b8099e', '99d8e5d8-9dc2-4305-bf3c-b3effa25bf91', 'c5158ffc-1831-4190-be8f-a626962d01f9', 'facd4db1-b2c9-48ca-b1ae-9f588bc6e656'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:42 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:42 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:42 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Deleted volume successfully. Nov 02 12:50:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b8ebf369-001f-40f2-b4f8-b5ea7b714120 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-87f32d49-4137-4479-95f2-dc7f3c99cde1-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (28f8dc6b-f645-43ac-991d-f3d92b53063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1af97c-78ab-44d2-86ef-34386cab2326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1af97c-78ab-44d2-86ef-34386cab2326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584679316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:43Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18781d5-ce8f-44c9-9d02-5fd954f16b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18781d5-ce8f-44c9-9d02-5fd954f16b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8523ee9d-ce71-49ab-8e5b-41c8dd8f25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8523ee9d-ce71-49ab-8e5b-41c8dd8f25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc', 'volume_name': 'volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64e020b-a4f2-46e5-8866-2f3649f4f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64e020b-a4f2-46e5-8866-2f3649f4f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2a655-3b34-428a-8e42-4414c5924063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:43 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Volume f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc', 'volume_size': 1} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584679316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:43Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Creating volume f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:43 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:43 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc 1073741824 Nov 02 12:50:43 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:44 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc 1073741824" returned: 0 in 0.529s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:44 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc Nov 02 12:50:44 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:44 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc2a655-3b34-428a-8e42-4414c5924063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17687177-6724-4297-8b49-0ec0f24270dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Volume volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc (f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc): created successfully Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17687177-6724-4297-8b49-0ec0f24270dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (28f8dc6b-f645-43ac-991d-f3d92b53063d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6c49300-4172-4162-b1b3-507013eea309 tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-quobyte-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[652fb4a0-0b0f-481e-8d6b-10f1f73e886d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:45 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc Nov 02 12:50:45 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:46 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" returned: 0 in 0.377s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:46 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc Nov 02 12:50:46 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:46 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" returned: 0 in 0.258s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc" released by "delete_volume" :: held 0.680s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Created reservations ['b61e139f-e24e-49a2-89ed-a3eabbec59c0', '0b2f04ac-1a45-4600-82f4-f2d153d2f18f', '41df6d64-f1ec-4577-8c4a-13b1a95a83fb', '03fdf5c2-8248-46fb-993e-a43d8ff42479'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:46 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:46 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:46 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Deleted volume successfully. Nov 02 12:50:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dab4b6c7-25b3-47a2-96b1-a3254ddb7ac4 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-f0e032d7-e8fc-4f37-8f63-18e39e9bd3fc-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (90262955-b423-4253-b659-12aa6da903cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35ce40b-8406-48d3-b5ab-3cdbbfdab137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35ce40b-8406-48d3-b5ab-3cdbbfdab137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1635878698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33560582-3cb4-426e-a66a-89fe176d6e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:47Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1e2ad4-a3f3-425f-84af-bf9b00bf11f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1e2ad4-a3f3-425f-84af-bf9b00bf11f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b64a544-ff5d-4fb1-a9f2-b61dceef21df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b64a544-ff5d-4fb1-a9f2-b61dceef21df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33560582-3cb4-426e-a66a-89fe176d6e9a', 'volume_name': 'volume-33560582-3cb4-426e-a66a-89fe176d6e9a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904cf30e-4ae2-4652-b3b3-e9f4849ad0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904cf30e-4ae2-4652-b3b3-e9f4849ad0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e01d75-d66e-47bb-94c9-7656a4ebee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Volume 33560582-3cb4-426e-a66a-89fe176d6e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33560582-3cb4-426e-a66a-89fe176d6e9a', 'volume_size': 1} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1635878698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33560582-3cb4-426e-a66a-89fe176d6e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:47Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Creating volume 33560582-3cb4-426e-a66a-89fe176d6e9a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:47 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:47 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a 1073741824 Nov 02 12:50:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:47 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a 1073741824" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:48 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a Nov 02 12:50:48 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:48 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e01d75-d66e-47bb-94c9-7656a4ebee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33560582-3cb4-426e-a66a-89fe176d6e9a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb13876b-de3a-4064-8393-7c4b53611627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Volume volume-33560582-3cb4-426e-a66a-89fe176d6e9a (33560582-3cb4-426e-a66a-89fe176d6e9a): created successfully Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb13876b-de3a-4064-8393-7c4b53611627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (90262955-b423-4253-b659-12aa6da903cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ce8f8e1a-cb5e-4f11-9843-69adec7d31cc tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-33560582-3cb4-426e-a66a-89fe176d6e9a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-33560582-3cb4-426e-a66a-89fe176d6e9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-quobyte-33560582-3cb4-426e-a66a-89fe176d6e9a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-33560582-3cb4-426e-a66a-89fe176d6e9a" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447b232-de17-4880-b49f-f7316c29fd7d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:48 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a Nov 02 12:50:48 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:49 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:49 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a Nov 02 12:50:49 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:49 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-33560582-3cb4-426e-a66a-89fe176d6e9a" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-33560582-3cb4-426e-a66a-89fe176d6e9a" released by "delete_volume" :: held 0.720s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Created reservations ['8085d6f3-ab0d-4714-b4b3-32668a6a991e', '92d610ca-19f8-4ee3-8f22-3889cca3c3a3', 'f0112120-a081-41c1-a6b9-b183dc2eec47', '5d82e154-a7fb-46e9-95a6-261d04e62a8a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:49 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:49 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:49 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.262s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Deleted volume successfully. Nov 02 12:50:49 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42664638-2c09-416a-b523-f87731ef15c3 tempest-VolumesActionsTest-1617009251 None] Lock "cinder-33560582-3cb4-426e-a66a-89fe176d6e9a-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (28ed3a0e-a6ca-4c6c-97ba-32255614f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76991b70-7845-40cb-a627-53591e21e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76991b70-7845-40cb-a627-53591e21e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719620376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9a092-f01a-497b-88f0-3ea9c67e3761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:50Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ad6af-26fc-4513-9396-1a517a68586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41ad6af-26fc-4513-9396-1a517a68586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e1fb4-d557-4d6c-be1a-f7fce5060836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752e1fb4-d557-4d6c-be1a-f7fce5060836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c9a092-f01a-497b-88f0-3ea9c67e3761', 'volume_name': 'volume-70c9a092-f01a-497b-88f0-3ea9c67e3761', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8245e-cbb2-4d64-a3f8-e33cfde7fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8245e-cbb2-4d64-a3f8-e33cfde7fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d411eb67-c765-4104-96a4-ad06ce80f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Volume 70c9a092-f01a-497b-88f0-3ea9c67e3761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c9a092-f01a-497b-88f0-3ea9c67e3761', 'volume_size': 1} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719620376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9a092-f01a-497b-88f0-3ea9c67e3761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:50Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Creating volume 70c9a092-f01a-497b-88f0-3ea9c67e3761 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:50 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 1073741824 Nov 02 12:50:50 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Flow 'volume_create_manager' (aa59bb28-6454-4952-aa68-2f7e5c3aa375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b977313-1dab-4f35-8d52-b48159c3a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b977313-1dab-4f35-8d52-b48159c3a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f336f-1724-4a06-86c4-62f424b21916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c66d9cd01247da94a38f6a6480a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:51Z,use_quota=True,user_id='6856832b71314dc7bd1702e94148c636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddfada9f-a220-4893-a482-5ecbc1948e3f),volume_type_id=ddfada9f-a220-4893-a482-5ecbc1948e3f)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3990161-f89e-4282-84c0-4d32e504feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3990161-f89e-4282-84c0-4d32e504feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4201b90e-8dfc-4606-973f-0b74eef9c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:50:50 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 1073741824" returned: 0 in 0.465s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:50 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 Nov 02 12:50:50 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:51 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4201b90e-8dfc-4606-973f-0b74eef9c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '858f336f-1724-4a06-86c4-62f424b21916', 'volume_name': 'volume-858f336f-1724-4a06-86c4-62f424b21916', 'volume_size': 1, 'image_id': '15c70fba-911e-4484-b481-70b9d1436895', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3bc9e200d82d902258bec99936042e9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c66d9cd01247da94a38f6a6480a30f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3f4df25d3265c208d6af01266ab0a74a37b33f9d4a0d86f782898c9c1201cb6edcd4d39a316b599842aa7fe433916ce5220abf4f0da39caac6aa6d72138e7cd', 'id': '15c70fba-911e-4484-b481-70b9d1436895', 'created_at': datetime.datetime(2026, 11, 2, 11, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15c70fba-911e-4484-b481-70b9d1436895/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222c4986-b5ca-494b-bbec-60af197130a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (222c4986-b5ca-494b-bbec-60af197130a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa9a28c-4c09-4955-a8fe-cd8718245b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Volume 858f336f-1724-4a06-86c4-62f424b21916: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-858f336f-1724-4a06-86c4-62f424b21916', 'volume_size': 1, 'image_id': '15c70fba-911e-4484-b481-70b9d1436895', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3bc9e200d82d902258bec99936042e9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c66d9cd01247da94a38f6a6480a30f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3f4df25d3265c208d6af01266ab0a74a37b33f9d4a0d86f782898c9c1201cb6edcd4d39a316b599842aa7fe433916ce5220abf4f0da39caac6aa6d72138e7cd', 'id': '15c70fba-911e-4484-b481-70b9d1436895', 'created_at': datetime.datetime(2026, 11, 2, 11, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15c70fba-911e-4484-b481-70b9d1436895/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Trying to clone 858f336f-1724-4a06-86c4-62f424b21916 from image 15c70fba-911e-4484-b481-70b9d1436895 at location (None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761" returned: 0 in 0.283s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d411eb67-c765-4104-96a4-ad06ce80f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c9a092-f01a-497b-88f0-3ea9c67e3761', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33f9dbb-b8c3-49a1-a4ca-4188a5e552f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Volume volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 (70c9a092-f01a-497b-88f0-3ea9c67e3761): created successfully Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33f9dbb-b8c3-49a1-a4ca-4188a5e552f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (28ed3a0e-a6ca-4c6c-97ba-32255614f2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-98b7618a-a96a-4a4a-beff-4bcd77e77bb0 tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:50:51 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7477bb-a8e3-446b-accf-3958989ed7d1]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:51 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:51 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:51 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:51 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:51 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:51 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:50:51 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Temporary image 15c70fba-911e-4484-b481-70b9d1436895 is fetched for user 6856832b71314dc7bd1702e94148c636. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0788cf-be76-4348-b043-02e0142adf38]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:52 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:52 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:52 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-70c9a092-f01a-497b-88f0-3ea9c67e3761-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:52 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:52 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "cinder-70c9a092-f01a-497b-88f0-3ea9c67e3761-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Acquiring lock "cinder-quobyte-70c9a092-f01a-497b-88f0-3ea9c67e3761" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-70c9a092-f01a-497b-88f0-3ea9c67e3761" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8418b3b-c4ff-40ab-b4dd-f926332e7c7f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:52 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 Nov 02 12:50:52 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:52 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858f336f-1724-4a06-86c4-62f424b21916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c66d9cd01247da94a38f6a6480a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:51Z,use_quota=True,user_id='6856832b71314dc7bd1702e94148c636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddfada9f-a220-4893-a482-5ecbc1948e3f),volume_type_id=ddfada9f-a220-4893-a482-5ecbc1948e3f)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Creating volume 858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:52 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:52 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1073741824 Nov 02 12:50:52 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:52 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:53 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761 Nov 02 12:50:53 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:53 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1073741824" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:53 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 Nov 02 12:50:53 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:53 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-70c9a092-f01a-497b-88f0-3ea9c67e3761" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "cinder-quobyte-70c9a092-f01a-497b-88f0-3ea9c67e3761" released by "delete_volume" :: held 0.707s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Created reservations ['5af18929-f072-4367-97e1-9ac037f5f93e', 'd2c60718-3a75-40d7-a74a-6ee98cc1b2c0', '5b960124-96cd-4c26-b908-a8c54c69c7b3', 'fda5132f-25ff-4901-9624-f6da2c6b2f19'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:53 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:53 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:53 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Attempting download of 15c70fba-911e-4484-b481-70b9d1436895 ((None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}])) to volume 858f336f-1724-4a06-86c4-62f424b21916. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c43c464-fed4-4d77-b4ab-32f2174f75af]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:53 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Deleted volume successfully. Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3ac71a4-f02f-4cfa-8e72-63bf0a2a4d5f tempest-VolumesActionsTest-1617009251 None] Lock "cinder-70c9a092-f01a-497b-88f0-3ea9c67e3761-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:53 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v Nov 02 12:50:53 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:53 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:54 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v Nov 02 12:50:54 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (d3421862-590c-40af-85ff-afd4dfa803d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150e833d-5838-4ef7-8639-3aa526409ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150e833d-5838-4ef7-8639-3aa526409ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1158319027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0544e33c-fda9-4e66-8991-3debe8989c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:54Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c7ebd-c4d3-4b92-bc5d-89dc898a1b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10c7ebd-c4d3-4b92-bc5d-89dc898a1b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7299a-51f4-4537-801e-4c5b6f8a2e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7299a-51f4-4537-801e-4c5b6f8a2e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0544e33c-fda9-4e66-8991-3debe8989c00', 'volume_name': 'volume-0544e33c-fda9-4e66-8991-3debe8989c00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d5e59-a242-417f-8871-776273ef27d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d5e59-a242-417f-8871-776273ef27d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e8df24-63d0-4917-b625-e865682d63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Volume 0544e33c-fda9-4e66-8991-3debe8989c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0544e33c-fda9-4e66-8991-3debe8989c00', 'volume_size': 1} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1158319027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0544e33c-fda9-4e66-8991-3debe8989c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d768dd2b3426d8827f44d5da75905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:50:54Z,use_quota=True,user_id='1ee9bc583e5f4428a6f681e21dda00bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Creating volume 0544e33c-fda9-4e66-8991-3debe8989c00 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:50:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:54 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v" returned: 1 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15c70fba-911e-4484-b481-70b9d1436895_fdn9is8v' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:50:54 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 1073741824 Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d24152-1bc1-447d-92b6-9cbdb03051ba]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:54 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:54 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:54 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:54 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:54 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 1073741824" returned: 0 in 0.418s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:54 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD Nov 02 12:50:54 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:54 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 Nov 02 12:50:54 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:54 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:54 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] 15c70fba-911e-4484-b481-70b9d1436895 was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e8df24-63d0-4917-b625-e865682d63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0544e33c-fda9-4e66-8991-3debe8989c00', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:55 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 Nov 02 12:50:55 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19426d4-f84e-4e76-870b-9b81572271c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Volume volume-0544e33c-fda9-4e66-8991-3debe8989c00 (0544e33c-fda9-4e66-8991-3debe8989c00): created successfully Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19426d4-f84e-4e76-870b-9b81572271c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Flow 'volume_create_manager' (d3421862-590c-40af-85ff-afd4dfa803d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-500249b2-874b-4401-90b3-ba2a8d05efc6 tempest-VolumesActionsTest-1521032708 None] Created volume successfully. Nov 02 12:50:55 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916" returned: 0 in 0.480s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15c70fba-911e-4484-b481-70b9d1436895_3xj079h9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:50:55 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:55 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1G Nov 02 12:50:55 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:55 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 1G" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Downloaded image 15c70fba-911e-4484-b481-70b9d1436895 ((None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}])) to volume 858f336f-1724-4a06-86c4-62f424b21916 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Temporary image 15c70fba-911e-4484-b481-70b9d1436895 for user 6856832b71314dc7bd1702e94148c636 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Marking volume 858f336f-1724-4a06-86c4-62f424b21916 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-0544e33c-fda9-4e66-8991-3debe8989c00-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Copying metadata from image 15c70fba-911e-4484-b481-70b9d1436895 to 858f336f-1724-4a06-86c4-62f424b21916. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Creating volume glance metadata for volume 858f336f-1724-4a06-86c4-62f424b21916 backed by image 15c70fba-911e-4484-b481-70b9d1436895 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '15c70fba-911e-4484-b481-70b9d1436895', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3bc9e200d82d902258bec99936042e9a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "cinder-0544e33c-fda9-4e66-8991-3debe8989c00-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Acquiring lock "cinder-quobyte-0544e33c-fda9-4e66-8991-3debe8989c00" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa9a28c-4c09-4955-a8fe-cd8718245b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858f336f-1724-4a06-86c4-62f424b21916', 'volume_size': 1, 'image_id': '15c70fba-911e-4484-b481-70b9d1436895', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15c70fba-911e-4484-b481-70b9d1436895', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3bc9e200d82d902258bec99936042e9a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '00c66d9cd01247da94a38f6a6480a30f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3f4df25d3265c208d6af01266ab0a74a37b33f9d4a0d86f782898c9c1201cb6edcd4d39a316b599842aa7fe433916ce5220abf4f0da39caac6aa6d72138e7cd', 'id': '15c70fba-911e-4484-b481-70b9d1436895', 'created_at': datetime.datetime(2026, 11, 2, 11, 50, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 50, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15c70fba-911e-4484-b481-70b9d1436895/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf423ba-f9c2-4410-a41d-e283fbc30fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:50:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "cinder-quobyte-0544e33c-fda9-4e66-8991-3debe8989c00" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Volume volume-858f336f-1724-4a06-86c4-62f424b21916 (858f336f-1724-4a06-86c4-62f424b21916): created successfully Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf423ba-f9c2-4410-a41d-e283fbc30fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Flow 'volume_create_manager' (aa59bb28-6454-4952-aa68-2f7e5c3aa375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f305c-e9bf-4fc3-b17a-3a34b4c1073c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cf86a889-e5c9-44d7-81f8-b05aaeeed8e0 tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Created volume successfully. Nov 02 12:50:56 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 Nov 02 12:50:56 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:56 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:56 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00 Nov 02 12:50:56 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:56 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0544e33c-fda9-4e66-8991-3debe8989c00" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "cinder-quobyte-0544e33c-fda9-4e66-8991-3debe8989c00" released by "delete_volume" :: held 0.647s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Created reservations ['aa49e134-aa45-4b72-85ed-33f073d03bb2', '9f9d49c6-bc66-45d7-8908-5e2b7b922e92', 'ed2a7878-cf82-4569-a39f-7c2d793b73e4', '39076eec-b2be-42a1-9c0e-169484b8d897'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:56 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:56 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:56 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Deleted volume successfully. Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d1c0d3b3-1e2b-4ec8-860b-4a894e5db83d tempest-VolumesActionsTest-1521032708 None] Lock "cinder-0544e33c-fda9-4e66-8991-3debe8989c00-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Acquiring lock "cinder-858f336f-1724-4a06-86c4-62f424b21916-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "cinder-858f336f-1724-4a06-86c4-62f424b21916-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Acquiring lock "cinder-quobyte-858f336f-1724-4a06-86c4-62f424b21916" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "cinder-quobyte-858f336f-1724-4a06-86c4-62f424b21916" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5357fbfd-fab8-4bae-8cfc-e37183788420]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:57 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 Nov 02 12:50:57 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:57 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:57 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916 Nov 02 12:50:57 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:57 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-858f336f-1724-4a06-86c4-62f424b21916" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "cinder-quobyte-858f336f-1724-4a06-86c4-62f424b21916" released by "delete_volume" :: held 0.742s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:50:57 devstack cinder-volume[86731]: WARNING cinder.quota [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:50:57 devstack cinder-volume[86731]: WARNING cinder.quota [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Created reservations ['0c68b783-ee0c-41c5-ac16-3286dcc42021', '9ffbdd0d-ed55-4f65-9f5a-4fd163f15b4e', 'dd9b6d6d-f846-414d-8f16-d6253179314b', '3c8f01bc-3e23-4ca9-bbee-3367f3f04451'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:50:58 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:50:58 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:50:58 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:50:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Deleted volume successfully. Nov 02 12:50:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e57734d0-911e-486c-91de-2f0d776da33a tempest-VolumeAndVolumeTypeFromImageTest-973168982 None] Lock "cinder-858f336f-1724-4a06-86c4-62f424b21916-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:02 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (8804fb1a-0b74-4a19-b702-8686252147c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5ec297-6a05-4954-a841-662e27c1b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5ec297-6a05-4954-a841-662e27c1b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303283410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06ca587-74a4-4d03-95d6-07523ae00ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:03Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dea4ff-7cfc-48b5-b216-d50f5228dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dea4ff-7cfc-48b5-b216-d50f5228dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee40d4-bd83-40e4-98ea-66a48d1a140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee40d4-bd83-40e4-98ea-66a48d1a140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06ca587-74a4-4d03-95d6-07523ae00ca8', 'volume_name': 'volume-b06ca587-74a4-4d03-95d6-07523ae00ca8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba6d9bc-b4c6-410a-8c5a-f8f39f585049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba6d9bc-b4c6-410a-8c5a-f8f39f585049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7629da-964e-4ba1-8bc8-bf4cb89c1a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume b06ca587-74a4-4d03-95d6-07523ae00ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06ca587-74a4-4d03-95d6-07523ae00ca8', 'volume_size': 1} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303283410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06ca587-74a4-4d03-95d6-07523ae00ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:03Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume b06ca587-74a4-4d03-95d6-07523ae00ca8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:03 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 1073741824 Nov 02 12:51:03 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:03 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 1073741824" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:03 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 Nov 02 12:51:03 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:03 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7629da-964e-4ba1-8bc8-bf4cb89c1a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06ca587-74a4-4d03-95d6-07523ae00ca8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d89c93-d922-4551-aca5-2419d285d6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 (b06ca587-74a4-4d03-95d6-07523ae00ca8): created successfully Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d89c93-d922-4551-aca5-2419d285d6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (8804fb1a-0b74-4a19-b702-8686252147c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-59b50d22-50e0-486c-9886-43a468414fc0 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (db19bd30-f471-449c-a3e2-abeb72f68c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dec2d5-6fbc-4dd7-be09-2daa261d9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dec2d5-6fbc-4dd7-be09-2daa261d9524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620530115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dced58c-0342-4287-af1b-740f006ec6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:04Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5521d6-1e5d-45fb-b947-6d7f7c04347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5521d6-1e5d-45fb-b947-6d7f7c04347c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0bff3d-03fa-493c-a171-dd0c807fe6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0bff3d-03fa-493c-a171-dd0c807fe6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dced58c-0342-4287-af1b-740f006ec6d6', 'volume_name': 'volume-2dced58c-0342-4287-af1b-740f006ec6d6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cc89a1-f17b-49f0-a8d4-c6dfeaf524d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cc89a1-f17b-49f0-a8d4-c6dfeaf524d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7752cc-7bc0-4a4d-85fd-f319b1c38990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume 2dced58c-0342-4287-af1b-740f006ec6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dced58c-0342-4287-af1b-740f006ec6d6', 'volume_size': 1} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620530115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dced58c-0342-4287-af1b-740f006ec6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:04Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume 2dced58c-0342-4287-af1b-740f006ec6d6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:04 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 1073741824 Nov 02 12:51:04 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (0bbb1aea-487b-44ca-8637-181fbbeecf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa24fc4-9822-4172-ae66-22f82e568a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa24fc4-9822-4172-ae66-22f82e568a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331942852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60aede1-a57c-43e9-875e-79c6baa8fac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:05Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445534df-fb89-42db-96bf-3d1b1b500259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445534df-fb89-42db-96bf-3d1b1b500259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8519928a-a7ae-45bd-94ee-6be2aa2758d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8519928a-a7ae-45bd-94ee-6be2aa2758d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60aede1-a57c-43e9-875e-79c6baa8fac9', 'volume_name': 'volume-a60aede1-a57c-43e9-875e-79c6baa8fac9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6dc34d-5d15-410a-a3e2-3f86f768a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6dc34d-5d15-410a-a3e2-3f86f768a150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537be6e8-6856-4a6e-90d5-acc0c502c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume a60aede1-a57c-43e9-875e-79c6baa8fac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60aede1-a57c-43e9-875e-79c6baa8fac9', 'volume_size': 1} Nov 02 12:51:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:05 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 1073741824" returned: 0 in 0.674s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (f24a33c9-94c1-418c-bd16-10b52db03c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb626ab6-8870-4925-abe9-db5d216364b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb626ab6-8870-4925-abe9-db5d216364b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472701809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01b2fc1-a848-4502-bb9e-585bec31af68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:05Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a748c12-504c-4b0d-a7c9-003e56ed693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a748c12-504c-4b0d-a7c9-003e56ed693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45985c99-e240-4db6-bd7a-aa91bfbae1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45985c99-e240-4db6-bd7a-aa91bfbae1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01b2fc1-a848-4502-bb9e-585bec31af68', 'volume_name': 'volume-c01b2fc1-a848-4502-bb9e-585bec31af68', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5940009f-40e9-4278-ba7a-dc35ece8124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5940009f-40e9-4278-ba7a-dc35ece8124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c952ece6-8184-4618-8109-ccd001b6e2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume c01b2fc1-a848-4502-bb9e-585bec31af68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01b2fc1-a848-4502-bb9e-585bec31af68', 'volume_size': 1} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:05 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 Nov 02 12:51:05 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:05 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331942852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60aede1-a57c-43e9-875e-79c6baa8fac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:05Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume a60aede1-a57c-43e9-875e-79c6baa8fac9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:05 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 1073741824 Nov 02 12:51:05 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7752cc-7bc0-4a4d-85fd-f319b1c38990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dced58c-0342-4287-af1b-740f006ec6d6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea52b57-b81c-47c6-aa1d-03a0ec669ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (2c69953a-ff0e-4250-ad2a-882aeccd0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d813bc-fea9-4dc8-bebd-8bd0298724cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-2dced58c-0342-4287-af1b-740f006ec6d6 (2dced58c-0342-4287-af1b-740f006ec6d6): created successfully Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea52b57-b81c-47c6-aa1d-03a0ec669ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (db19bd30-f471-449c-a3e2-abeb72f68c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d813bc-fea9-4dc8-bebd-8bd0298724cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255108551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5bcb70-5a2c-41f9-af59-3d7013f2c626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:06Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37b3a71-75ad-4cfd-abbf-b48c7afe70a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37b3a71-75ad-4cfd-abbf-b48c7afe70a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc62c7f4-17de-45bc-999c-b9ac94d37507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc62c7f4-17de-45bc-999c-b9ac94d37507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5bcb70-5a2c-41f9-af59-3d7013f2c626', 'volume_name': 'volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8577cd-a9ea-4b4b-a0ba-3517492da6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8577cd-a9ea-4b4b-a0ba-3517492da6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359f5a2c-26eb-4d07-91bd-7f58cb955ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume fc5bcb70-5a2c-41f9-af59-3d7013f2c626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626', 'volume_size': 1} Nov 02 12:51:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-537a71a6-387c-40a3-af10-48d49d35213a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (0ef7d754-728a-4841-9460-fb99200790ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61410ce0-8e51-4b94-ae74-742b48b44d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61410ce0-8e51-4b94-ae74-742b48b44d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221077222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:06Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e915ae-4df6-4327-b419-a8dcde3db00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e915ae-4df6-4327-b419-a8dcde3db00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41540a83-9192-43f8-895c-0c2a5cb5a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41540a83-9192-43f8-895c-0c2a5cb5a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2', 'volume_name': 'volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283eb59b-0aed-4354-95c5-df25bc227124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283eb59b-0aed-4354-95c5-df25bc227124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38794a3b-747e-407d-82ec-2cfbe13d43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume 0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2', 'volume_size': 1} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:06 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 1073741824" returned: 0 in 0.631s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:06 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 Nov 02 12:51:06 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:06 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.293s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472701809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01b2fc1-a848-4502-bb9e-585bec31af68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:05Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume c01b2fc1-a848-4502-bb9e-585bec31af68 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:06 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:06 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 1073741824 Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537be6e8-6856-4a6e-90d5-acc0c502c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60aede1-a57c-43e9-875e-79c6baa8fac9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4351b81-deb2-46a8-9b5f-13b855e522ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 (a60aede1-a57c-43e9-875e-79c6baa8fac9): created successfully Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4351b81-deb2-46a8-9b5f-13b855e522ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (0bbb1aea-487b-44ca-8637-181fbbeecf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d5a7cb75-82e7-42c4-b732-47c319f83f02 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:07 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 1073741824" returned: 0 in 0.472s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:07 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 Nov 02 12:51:07 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:07 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255108551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5bcb70-5a2c-41f9-af59-3d7013f2c626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:06Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume fc5bcb70-5a2c-41f9-af59-3d7013f2c626 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c952ece6-8184-4618-8109-ccd001b6e2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01b2fc1-a848-4502-bb9e-585bec31af68', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:07 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 1073741824 Nov 02 12:51:07 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cc27d8-a2c8-49d9-98d3-ba050509c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-c01b2fc1-a848-4502-bb9e-585bec31af68 (c01b2fc1-a848-4502-bb9e-585bec31af68): created successfully Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cc27d8-a2c8-49d9-98d3-ba050509c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (f24a33c9-94c1-418c-bd16-10b52db03c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-75e35be9-3d6f-41a9-9131-f9d7afa9e58a tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:08 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 1073741824" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:08 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 Nov 02 12:51:08 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:08 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221077222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7c5fab6e14f9f934a04a0f0549b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:06Z,use_quota=True,user_id='02638d71115f4173af5487fed22608fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Creating volume 0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359f5a2c-26eb-4d07-91bd-7f58cb955ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb3cbbf-2c6e-4c61-8ae4-dd880e6b7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:08 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 1073741824 Nov 02 12:51:08 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 (fc5bcb70-5a2c-41f9-af59-3d7013f2c626): created successfully Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb3cbbf-2c6e-4c61-8ae4-dd880e6b7b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (2c69953a-ff0e-4250-ad2a-882aeccd0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-76f47445-06b1-4f08-b8d7-861d7287c79b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:08 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 1073741824" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:08 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 Nov 02 12:51:08 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:09 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38794a3b-747e-407d-82ec-2cfbe13d43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9439b4-389a-47a1-9d6e-09e8c179d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Volume volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 (0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2): created successfully Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9439b4-389a-47a1-9d6e-09e8c179d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Flow 'volume_create_manager' (0ef7d754-728a-4841-9460-fb99200790ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8dbe38db-ddf9-4efd-9dc3-e3d39705c8bd tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created volume successfully. Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f80251-e035-48eb-98ca-388c869a971e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:09 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 Nov 02 12:51:09 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:10 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" returned: 0 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:10 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2 Nov 02 12:51:10 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:10 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2" released by "delete_volume" :: held 0.699s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['d04fbc7d-2771-4bb0-b643-b7837a51ce33', 'b70aa990-110e-4ad8-82a3-d19b0e037133', 'd4c900da-30a1-4db2-8998-ea8712c30a25', '20716b22-268a-4653-923f-d09062d0df6e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:10 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:10 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-fc5bcb70-5a2c-41f9-af59-3d7013f2c626-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-fc5bcb70-5a2c-41f9-af59-3d7013f2c626-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:10 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.303s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-83edd50c-dc63-482e-a0e7-0fe4ca318bc5 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-0f1eed2b-6ec1-4fa0-99f5-8868ff62e6e2-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbde835c-0890-4314-90b7-24b962fd1689]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:11 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 Nov 02 12:51:11 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:11 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:11 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626 Nov 02 12:51:11 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:11 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-fc5bcb70-5a2c-41f9-af59-3d7013f2c626" released by "delete_volume" :: held 0.673s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['86fe0690-52a0-49fc-b0fa-5173f0581366', 'f645c20e-ae4f-424e-a8ec-936ccdc14155', '261f0d70-a6e8-4249-81b6-8d7abce05ad9', '5c0a3030-66ab-453b-91a8-5853ca57d980'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:11 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:11 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-c01b2fc1-a848-4502-bb9e-585bec31af68-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:12 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-c01b2fc1-a848-4502-bb9e-585bec31af68-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-386c9c22-de7a-4c8f-961d-7ab49e385e56 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-fc5bcb70-5a2c-41f9-af59-3d7013f2c626-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-c01b2fc1-a848-4502-bb9e-585bec31af68" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-c01b2fc1-a848-4502-bb9e-585bec31af68" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e833a-4028-40c3-82ec-36125b8692eb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:12 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 Nov 02 12:51:12 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:12 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68" returned: 0 in 0.390s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:12 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68 Nov 02 12:51:12 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:12 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c01b2fc1-a848-4502-bb9e-585bec31af68" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-c01b2fc1-a848-4502-bb9e-585bec31af68" released by "delete_volume" :: held 0.681s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['1a10994d-deea-4a3f-9b77-a659b4d75c0a', 'f56db17a-5349-4552-8ecd-37f8d10c0c0c', '5f004cc8-a381-4a76-95df-845189c2ad06', 'a74f4264-3347-4808-8293-4dd5fb1323c4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:13 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:13 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:13 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.258s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-a60aede1-a57c-43e9-875e-79c6baa8fac9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-70c10ec4-a71d-4c7e-9fbf-35611091d4d7 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-c01b2fc1-a848-4502-bb9e-585bec31af68-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-a60aede1-a57c-43e9-875e-79c6baa8fac9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-a60aede1-a57c-43e9-875e-79c6baa8fac9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-a60aede1-a57c-43e9-875e-79c6baa8fac9" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79df061-a384-4bff-818c-355ae4225c4c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:13 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 Nov 02 12:51:13 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:13 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:13 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9 Nov 02 12:51:13 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:14 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a60aede1-a57c-43e9-875e-79c6baa8fac9" returned: 0 in 0.274s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-a60aede1-a57c-43e9-875e-79c6baa8fac9" released by "delete_volume" :: held 0.694s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['bbadfba3-07da-4c17-a907-294f507b7a98', 'cbc95542-a0c6-453f-903a-23e96f990bad', '791c642f-b2cc-4021-a1a0-5f93316a8d2e', 'f80256ee-c91b-4693-947c-ae1e9b817c37'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:14 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:14 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:14 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-2dced58c-0342-4287-af1b-740f006ec6d6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2c5a2a3e-0175-465c-a53f-e3c4ea8e9bed tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-a60aede1-a57c-43e9-875e-79c6baa8fac9-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-2dced58c-0342-4287-af1b-740f006ec6d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-2dced58c-0342-4287-af1b-740f006ec6d6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-2dced58c-0342-4287-af1b-740f006ec6d6" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36a8fd5-3882-4a6f-8eda-0f751982ba52]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:14 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 Nov 02 12:51:14 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:15 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6" returned: 0 in 0.371s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:15 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6 Nov 02 12:51:15 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:15 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2dced58c-0342-4287-af1b-740f006ec6d6" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-2dced58c-0342-4287-af1b-740f006ec6d6" released by "delete_volume" :: held 0.662s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['c6a2bbe1-b99f-4bc6-a531-1be0f07ef085', '4cb79da2-7e58-43cf-9e2a-626fc7a4114a', '43e8f049-9fb9-4e35-a638-ec082cfa7933', '8231e443-4c29-49bf-bc9e-f384ba9a538a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:15 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:15 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:15 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-b06ca587-74a4-4d03-95d6-07523ae00ca8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-193e0659-9881-4e42-9a3c-413c3b82410b tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-2dced58c-0342-4287-af1b-740f006ec6d6-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-b06ca587-74a4-4d03-95d6-07523ae00ca8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "cinder-quobyte-b06ca587-74a4-4d03-95d6-07523ae00ca8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-b06ca587-74a4-4d03-95d6-07523ae00ca8" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c0bfdf-1441-4993-bdc4-885bfa7ededb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:15 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 Nov 02 12:51:15 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:16 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8" returned: 0 in 0.383s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:16 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8 Nov 02 12:51:16 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:16 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b06ca587-74a4-4d03-95d6-07523ae00ca8" returned: 0 in 0.258s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-quobyte-b06ca587-74a4-4d03-95d6-07523ae00ca8" released by "delete_volume" :: held 0.689s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Created reservations ['e352571e-b359-4e28-b025-045d323be2da', '2164509e-caf3-438b-ad50-1b9ca8cf5ae1', '7681dca5-5fd9-4508-bed1-0a33592ab2dd', 'f8069d43-2919-4f38-9dfa-4f84b1007093'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:16 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:16 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (c03d7203-a907-4223-82b6-22600f545c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aaf495-cc34-4927-a0b1-51bd0bf79e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aaf495-cc34-4927-a0b1-51bd0bf79e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36899703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539b7a48-c4b9-4c27-b892-bce7071934b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:17Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fbd25b-1a4f-4558-b8bf-7be8e8e9def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fbd25b-1a4f-4558-b8bf-7be8e8e9def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bb5215-ff82-4f3d-b015-75aad97b87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bb5215-ff82-4f3d-b015-75aad97b87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539b7a48-c4b9-4c27-b892-bce7071934b9', 'volume_name': 'volume-539b7a48-c4b9-4c27-b892-bce7071934b9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f26d3e-3e0f-4a48-a7b3-f6afe8fc87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f26d3e-3e0f-4a48-a7b3-f6afe8fc87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ec7c25-91ef-4868-9987-f012140cd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Volume 539b7a48-c4b9-4c27-b892-bce7071934b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539b7a48-c4b9-4c27-b892-bce7071934b9', 'volume_size': 1} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-36899703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539b7a48-c4b9-4c27-b892-bce7071934b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:17Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Creating volume 539b7a48-c4b9-4c27-b892-bce7071934b9 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:16 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Deleted volume successfully. Nov 02 12:51:16 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 1073741824 Nov 02 12:51:16 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-113debe8-a612-4fcf-a58f-6243b05975d8 tempest-CreateVolumesFromSourceVolumeTest-1958743149 None] Lock "cinder-b06ca587-74a4-4d03-95d6-07523ae00ca8-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:17 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 1073741824" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:17 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 Nov 02 12:51:17 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:17 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ec7c25-91ef-4868-9987-f012140cd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539b7a48-c4b9-4c27-b892-bce7071934b9', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda7851-752d-471c-9f6e-55d412bde6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Volume volume-539b7a48-c4b9-4c27-b892-bce7071934b9 (539b7a48-c4b9-4c27-b892-bce7071934b9): created successfully Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bda7851-752d-471c-9f6e-55d412bde6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (c03d7203-a907-4223-82b6-22600f545c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f777bf6a-4cce-480e-a38a-6b996d52e478 tempest-VolumesListTestJSON-1924099733 None] Created volume successfully. Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (dabd740f-89f6-4db5-9f2f-b5c17d625b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad3d02e-5d49-4ed8-a74b-b6b045c05a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad3d02e-5d49-4ed8-a74b-b6b045c05a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-983747204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560a34d0-e441-46b1-93e5-8cefdc993323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:19Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4922c87b-f40c-44ec-9604-a213a5d85703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4922c87b-f40c-44ec-9604-a213a5d85703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c614acb-8849-48d6-9f13-342a15e4ec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c614acb-8849-48d6-9f13-342a15e4ec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560a34d0-e441-46b1-93e5-8cefdc993323', 'volume_name': 'volume-560a34d0-e441-46b1-93e5-8cefdc993323', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613dbed-b39e-4174-926b-ab0bcf43b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613dbed-b39e-4174-926b-ab0bcf43b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aa0be5-8261-497c-9c9d-94d28e025357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:19 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Volume 560a34d0-e441-46b1-93e5-8cefdc993323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560a34d0-e441-46b1-93e5-8cefdc993323', 'volume_size': 1} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-983747204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560a34d0-e441-46b1-93e5-8cefdc993323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:19Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Creating volume 560a34d0-e441-46b1-93e5-8cefdc993323 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:19 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:19 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 1073741824 Nov 02 12:51:19 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:19 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 1073741824" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:19 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 Nov 02 12:51:19 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:20 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aa0be5-8261-497c-9c9d-94d28e025357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560a34d0-e441-46b1-93e5-8cefdc993323', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225c8b5b-6ef8-4d6c-99d2-1ba5bb122987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Volume volume-560a34d0-e441-46b1-93e5-8cefdc993323 (560a34d0-e441-46b1-93e5-8cefdc993323): created successfully Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225c8b5b-6ef8-4d6c-99d2-1ba5bb122987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (dabd740f-89f6-4db5-9f2f-b5c17d625b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-daaf782f-fb97-4f72-b502-64a1fc9de1ab tempest-VolumesListTestJSON-1924099733 None] Created volume successfully. Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=116,cinder:UPDATE=169,cinder:INSERT=39,cinder:DELETE=12 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=113,cinder:UPDATE=157,cinder:DELETE=17,cinder:INSERT=44 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (d7b72a26-10e4-4120-b4fa-d86dfb69d7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8614b20c-974c-4e95-b5c6-5f294a8c835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8614b20c-974c-4e95-b5c6-5f294a8c835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-75893195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387c99ca-c0f1-4a68-af1b-e380be8a7638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:21Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d28b36b-a84c-44a5-9602-99fbd0a0aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d28b36b-a84c-44a5-9602-99fbd0a0aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5a534e-bf62-4a6a-9adc-7c8978ba435e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5a534e-bf62-4a6a-9adc-7c8978ba435e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387c99ca-c0f1-4a68-af1b-e380be8a7638', 'volume_name': 'volume-387c99ca-c0f1-4a68-af1b-e380be8a7638', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29998b-dacb-4813-99ea-3978db6ce83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29998b-dacb-4813-99ea-3978db6ce83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d760c4e-b1f0-4897-ba9e-a18738b12d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Volume 387c99ca-c0f1-4a68-af1b-e380be8a7638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387c99ca-c0f1-4a68-af1b-e380be8a7638', 'volume_size': 1} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-75893195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387c99ca-c0f1-4a68-af1b-e380be8a7638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90f17429d1da45e3bd638289f3c0acec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:21Z,use_quota=True,user_id='53dde053f1f4480d89b247086651d803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Creating volume 387c99ca-c0f1-4a68-af1b-e380be8a7638 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:21 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:21 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 1073741824 Nov 02 12:51:21 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:21 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 1073741824" returned: 0 in 0.452s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:21 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 Nov 02 12:51:21 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:21 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d760c4e-b1f0-4897-ba9e-a18738b12d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387c99ca-c0f1-4a68-af1b-e380be8a7638', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e2d75e-ad2b-4415-bc8f-e96d7560f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Volume volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 (387c99ca-c0f1-4a68-af1b-e380be8a7638): created successfully Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e2d75e-ad2b-4415-bc8f-e96d7560f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Flow 'volume_create_manager' (d7b72a26-10e4-4120-b4fa-d86dfb69d7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-75427c50-ee10-41d7-9ffb-382df9052931 tempest-VolumesListTestJSON-1924099733 None] Created volume successfully. Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Flow 'volume_create_manager' (a2fd285e-b164-49a3-a9cb-9f1fb79bff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fab9ea-7666-4c84-ad98-8a2791039f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fab9ea-7666-4c84-ad98-8a2791039f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157d3c2ecda9417ebc64c3fea022b8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:22Z,use_quota=True,user_id='ea13d8af0e6d45bbac0a937706bc1e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55981760-7be1-4507-8357-012a3ec4feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55981760-7be1-4507-8357-012a3ec4feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0637d-384d-4e73-8c24-50240ea25c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b0637d-384d-4e73-8c24-50240ea25c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e', 'volume_name': 'volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e', 'volume_size': 1, 'image_id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b62c5ba73ccaa822151ec83d34c42a4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '157d3c2ecda9417ebc64c3fea022b8d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b79e9aab1a9dd22ee7576b11b8e03b18d4527552dbc8d5a5ab15299091ed532c8730cf609e47026a78fe63e839ed569c38a11af0b38ae17b931c257c74b655c', 'id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'created_at': datetime.datetime(2026, 11, 2, 11, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e78f0e0a-3383-470d-9ea2-96611cce9482/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4235a4-4e20-4b11-acdf-e7f6c99f5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4235a4-4e20-4b11-acdf-e7f6c99f5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca9c02f-003e-4570-b8b7-b2a98b3f28c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:22 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e', 'volume_size': 1, 'image_id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b62c5ba73ccaa822151ec83d34c42a4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '157d3c2ecda9417ebc64c3fea022b8d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b79e9aab1a9dd22ee7576b11b8e03b18d4527552dbc8d5a5ab15299091ed532c8730cf609e47026a78fe63e839ed569c38a11af0b38ae17b931c257c74b655c', 'id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'created_at': datetime.datetime(2026, 11, 2, 11, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e78f0e0a-3383-470d-9ea2-96611cce9482/file', 'properties': {}}, 'image_service': } Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Trying to clone fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e from image e78f0e0a-3383-470d-9ea2-96611cce9482 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:51:22 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cef12e-ea9f-4256-8d63-95fef96d29c1]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:22 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:22 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:22 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:23 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:23 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:23 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Temporary image e78f0e0a-3383-470d-9ea2-96611cce9482 is fetched for user ea13d8af0e6d45bbac0a937706bc1e50. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd234b-33cc-482f-b40c-a2e320b4b573]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:23 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:23 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:23 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:23 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:23 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:23 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='157d3c2ecda9417ebc64c3fea022b8d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:22Z,use_quota=True,user_id='ea13d8af0e6d45bbac0a937706bc1e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Creating volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:23 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:24 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1073741824 Nov 02 12:51:24 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:24 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1073741824" returned: 0 in 0.440s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:24 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e Nov 02 12:51:24 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:24 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Attempting download of e78f0e0a-3383-470d-9ea2-96611cce9482 ((None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}])) to volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[3593759c-f98c-4b39-93e5-65f854ca9e96]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:24 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht Nov 02 12:51:24 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-387c99ca-c0f1-4a68-af1b-e380be8a7638-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-387c99ca-c0f1-4a68-af1b-e380be8a7638-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-quobyte-387c99ca-c0f1-4a68-af1b-e380be8a7638" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-387c99ca-c0f1-4a68-af1b-e380be8a7638" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:25 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[157812c9-422d-4b64-8fd8-8b9e16a1c211]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:25 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht Nov 02 12:51:25 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:25 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 Nov 02 12:51:25 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:25 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht" returned: 1 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e78f0e0a-3383-470d-9ea2-96611cce9482__enafvht' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f5b216-9ea8-4fda-bca6-151c47345020]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:25 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:25 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638 Nov 02 12:51:25 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:25 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:25 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:25 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-387c99ca-c0f1-4a68-af1b-e380be8a7638" returned: 0 in 0.263s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-387c99ca-c0f1-4a68-af1b-e380be8a7638" released by "delete_volume" :: held 0.694s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:25 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:25 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Created reservations ['17cb9c49-311f-429e-bf9f-1b68b3f364bc', '3e2adce2-a0ab-45a9-886c-ddbb25db7d01', '741b000e-db23-4fd4-903e-48de00fa79c0', 'b7f1d2a7-94b0-4c50-94bc-604686834775'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:26 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD Nov 02 12:51:26 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:26 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:26 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:26 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] e78f0e0a-3383-470d-9ea2-96611cce9482 was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:26 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:26 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e Nov 02 12:51:26 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Deleted volume successfully. Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-560a34d0-e441-46b1-93e5-8cefdc993323-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a636f0d1-1908-4d4c-8fd2-ed1d5a5eb922 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-387c99ca-c0f1-4a68-af1b-e380be8a7638-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-560a34d0-e441-46b1-93e5-8cefdc993323-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-quobyte-560a34d0-e441-46b1-93e5-8cefdc993323" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-560a34d0-e441-46b1-93e5-8cefdc993323" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e5513-9b39-4ade-b800-4bd1360539ae]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:26 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 Nov 02 12:51:26 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:26 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" returned: 0 in 0.507s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e78f0e0a-3383-470d-9ea2-96611cce9482_03lmz5ttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:51:26 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:26 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1G Nov 02 12:51:26 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:26 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:26 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323 Nov 02 12:51:26 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:27 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e 1G" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Downloaded image e78f0e0a-3383-470d-9ea2-96611cce9482 ((None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}])) to volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Temporary image e78f0e0a-3383-470d-9ea2-96611cce9482 for user ea13d8af0e6d45bbac0a937706bc1e50 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Marking volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Copying metadata from image e78f0e0a-3383-470d-9ea2-96611cce9482 to fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Creating volume glance metadata for volume fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e backed by image e78f0e0a-3383-470d-9ea2-96611cce9482 with: {'image_id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b62c5ba73ccaa822151ec83d34c42a4d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:51:27 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-560a34d0-e441-46b1-93e5-8cefdc993323" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-560a34d0-e441-46b1-93e5-8cefdc993323" released by "delete_volume" :: held 0.750s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca9c02f-003e-4570-b8b7-b2a98b3f28c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e', 'volume_size': 1, 'image_id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e78f0e0a-3383-470d-9ea2-96611cce9482', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b62c5ba73ccaa822151ec83d34c42a4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '157d3c2ecda9417ebc64c3fea022b8d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b79e9aab1a9dd22ee7576b11b8e03b18d4527552dbc8d5a5ab15299091ed532c8730cf609e47026a78fe63e839ed569c38a11af0b38ae17b931c257c74b655c', 'id': 'e78f0e0a-3383-470d-9ea2-96611cce9482', 'created_at': datetime.datetime(2026, 11, 2, 11, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e78f0e0a-3383-470d-9ea2-96611cce9482/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f741bb-0810-46a3-91b8-1944cb0a4644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Volume volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e (fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e): created successfully Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f741bb-0810-46a3-91b8-1944cb0a4644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Flow 'volume_create_manager' (a2fd285e-b164-49a3-a9cb-9f1fb79bff7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Created reservations ['ba54c28e-09af-4c86-88f3-2e4a0a8d3bca', '7eeb20aa-53f8-4534-b118-79af9a78799d', 'f13ea56f-b557-4e87-b6bd-f455dd7979d3', '75caff86-c0be-4322-9580-d3413cc9c2b2'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7b7cdea1-8069-4804-bece-9bb40929af26 tempest-VolumeImageDependencyTests-947160951 None] Created volume successfully. Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:27 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:27 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Acquiring lock "cinder-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "cinder-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-539b7a48-c4b9-4c27-b892-bce7071934b9-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Acquiring lock "cinder-quobyte-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:27 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-539b7a48-c4b9-4c27-b892-bce7071934b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Deleted volume successfully. Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "cinder-quobyte-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61054a-7055-4098-a456-23b4977d4435]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-04b202c2-6e66-4f0d-962a-2d402d4b0cfc tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-560a34d0-e441-46b1-93e5-8cefdc993323-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "cinder-quobyte-539b7a48-c4b9-4c27-b892-bce7071934b9" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-539b7a48-c4b9-4c27-b892-bce7071934b9" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[722de5cc-3fcd-4462-b2bd-11521b91a677]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:27 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e Nov 02 12:51:27 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:27 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 Nov 02 12:51:27 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:28 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" returned: 0 in 0.405s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:28 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e Nov 02 12:51:28 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:28 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:28 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9 Nov 02 12:51:28 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:28 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "cinder-quobyte-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e" released by "delete_volume" :: held 0.721s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:28 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-539b7a48-c4b9-4c27-b892-bce7071934b9" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-quobyte-539b7a48-c4b9-4c27-b892-bce7071934b9" released by "delete_volume" :: held 0.681s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Created reservations ['1ea17f4b-6481-4882-bd4c-ce9e8089afa9', 'e190c817-b087-474a-af22-76f564b7e246', '053ec754-9244-416c-b1e7-0240d428dbc0', '4c32110c-e5ba-4cb0-bc8d-c9f6a86a868c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Created reservations ['823bfd47-4956-465e-bc5f-932d5cc611dd', '7f306df1-982f-47d0-9fc7-a71476b5f3b0', '16b9f3aa-3ac2-4a03-987f-a402e2230e3c', '3b2ec8f3-935e-4bb8-a441-d33a16f385dc'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:28 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:28 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:28 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:28 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:28 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.309s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Deleted volume successfully. Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-02f31092-96dd-4247-88e5-27ce341560cc tempest-VolumeImageDependencyTests-947160951 None] Lock "cinder-fbd6602d-4be1-4381-b1d5-f93ee0ec3d0e-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:28 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.386s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Deleted volume successfully. Nov 02 12:51:29 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:51:29 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e6da1e83-7d0b-4b53-b014-1d4d69668ef9 tempest-VolumesListTestJSON-1924099733 None] Lock "cinder-539b7a48-c4b9-4c27-b892-bce7071934b9-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:51:29 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:51:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:51:38 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=31,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:51:39 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=41,cinder:INSERT=17,cinder:SELECT=27,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:51:53 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:51:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Flow 'volume_create_manager' (b610b1bf-8f81-4d88-b3ed-40e5947487cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ecc5d8-0ddf-48af-a531-e3db80402263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ecc5d8-0ddf-48af-a531-e3db80402263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-701870716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3370c176-0165-40e5-894f-59f3efd8ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a94b5dfc6df44c4bb8147cdf5debd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:54Z,use_quota=True,user_id='eec78eb1a29c441ca1458cd88da0c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe216b2f-a363-407d-a693-4fe59bbb2e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe216b2f-a363-407d-a693-4fe59bbb2e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85dba2-8749-40ac-bde7-2e40ce6edae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d85dba2-8749-40ac-bde7-2e40ce6edae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3370c176-0165-40e5-894f-59f3efd8ce5d', 'volume_name': 'volume-3370c176-0165-40e5-894f-59f3efd8ce5d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173fa676-7a64-47e3-a8d4-647139ff3032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173fa676-7a64-47e3-a8d4-647139ff3032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16a161-4da9-47ac-bee2-64b20cdd6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Volume 3370c176-0165-40e5-894f-59f3efd8ce5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3370c176-0165-40e5-894f-59f3efd8ce5d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Trying to clone 3370c176-0165-40e5-894f-59f3efd8ce5d from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:51:54 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c507adf6-a7a3-4901-a753-7ff2fda93528]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:54 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD Nov 02 12:51:54 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:55 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b is fetched for user eec78eb1a29c441ca1458cd88da0c541. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984de10-57a9-48b3-8501-969236475cab]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:55 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD Nov 02 12:51:55 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:55 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-701870716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3370c176-0165-40e5-894f-59f3efd8ce5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a94b5dfc6df44c4bb8147cdf5debd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:51:54Z,use_quota=True,user_id='eec78eb1a29c441ca1458cd88da0c541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Creating volume 3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:51:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:55 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1073741824 Nov 02 12:51:55 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:55 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1073741824" returned: 0 in 0.410s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:55 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d Nov 02 12:51:55 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:56 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Attempting download of 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 3370c176-0165-40e5-894f-59f3efd8ce5d. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2eac35-2ef9-41ef-875b-091c3c5d9709]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:56 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d Nov 02 12:51:56 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:56 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:56 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d Nov 02 12:51:56 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:56 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d" returned: 1 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_1s4jql5d' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[704b4569-bb0d-47f6-82aa-2b461da9d99c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:51:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:56 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD Nov 02 12:51:56 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:57 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:57 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b was qcow2, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:51:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:57 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d Nov 02 12:51:57 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:58 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d" returned: 0 in 1.716s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:58 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b_q_dvn8hidevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:51:58 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Converted 112.00 MB image at 65.22 MB/s Nov 02 12:51:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:51:58 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1G Nov 02 12:51:58 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:51:59 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d 1G" returned: 0 in 0.306s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Downloaded image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}])) to volume 3370c176-0165-40e5-894f-59f3efd8ce5d successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Temporary image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b for user eec78eb1a29c441ca1458cd88da0c541 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Marking volume 3370c176-0165-40e5-894f-59f3efd8ce5d as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Copying metadata from image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b to 3370c176-0165-40e5-894f-59f3efd8ce5d. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Creating volume glance metadata for volume 3370c176-0165-40e5-894f-59f3efd8ce5d backed by image 6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16a161-4da9-47ac-bee2-64b20cdd6016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3370c176-0165-40e5-894f-59f3efd8ce5d', 'volume_size': 1, 'image_id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7907fbe8d0fd450f9ef112779fe7bfa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3fdd93-12c5-4bd6-ab58-4a51cc8c392b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034b5298-75d8-40b2-881b-b5249b0cb6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:51:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Volume volume-3370c176-0165-40e5-894f-59f3efd8ce5d (3370c176-0165-40e5-894f-59f3efd8ce5d): created successfully Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034b5298-75d8-40b2-881b-b5249b0cb6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:51:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Flow 'volume_create_manager' (b610b1bf-8f81-4d88-b3ed-40e5947487cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:51:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3040947-0cab-4941-8283-96888a1f6f1c tempest-TestShelveInstance-1511948023 None] Created volume successfully. Nov 02 12:52:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0971af48-42ce-42a3-853d-651b41ff5c73 req-954cfd86-2d1e-4d57-af46-8492b9f70291 tempest-TestShelveInstance-1511948023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:52:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0971af48-42ce-42a3-853d-651b41ff5c73 req-954cfd86-2d1e-4d57-af46-8492b9f70291 tempest-TestShelveInstance-1511948023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:52:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-0971af48-42ce-42a3-853d-651b41ff5c73 req-954cfd86-2d1e-4d57-af46-8492b9f70291 tempest-TestShelveInstance-1511948023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:52:02 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-0971af48-42ce-42a3-853d-651b41ff5c73 req-954cfd86-2d1e-4d57-af46-8492b9f70291 tempest-TestShelveInstance-1511948023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-3370c176-0165-40e5-894f-59f3efd8ce5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47cb2d37-7a73-4404-a91f-5d49e34d9424', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:52:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-0971af48-42ce-42a3-853d-651b41ff5c73 req-954cfd86-2d1e-4d57-af46-8492b9f70291 tempest-TestShelveInstance-1511948023 None] attachment_update completed successfully. Nov 02 12:52:12 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:52:12 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=9,cinder:SELECT=14,cinder:INSERT=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:52:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:52:28 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:52:28 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:52:29 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 02 12:52:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:52:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:52:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:52:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:52:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:52:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-eedbd25d-e14d-4537-9e9e-abe09134b35b req-4de751af-583b-43d4-abb7-df5f75d13465 tempest-TestShelveInstance-1511948023 None] Terminate volume connection completed successfully. Nov 02 12:52:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-eedbd25d-e14d-4537-9e9e-abe09134b35b req-4de751af-583b-43d4-abb7-df5f75d13465 tempest-TestShelveInstance-1511948023 None] Deleting attachment 47cb2d37-7a73-4404-a91f-5d49e34d9424. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:52:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9d162e11-56e2-485a-abeb-ac4381a85e2c req-416dfa10-8a35-4e93-a0fe-4cee92cfc0c9 tempest-TestShelveInstance-1511948023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:52:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9d162e11-56e2-485a-abeb-ac4381a85e2c req-416dfa10-8a35-4e93-a0fe-4cee92cfc0c9 tempest-TestShelveInstance-1511948023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:52:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-9d162e11-56e2-485a-abeb-ac4381a85e2c req-416dfa10-8a35-4e93-a0fe-4cee92cfc0c9 tempest-TestShelveInstance-1511948023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:52:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-9d162e11-56e2-485a-abeb-ac4381a85e2c req-416dfa10-8a35-4e93-a0fe-4cee92cfc0c9 tempest-TestShelveInstance-1511948023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755', 'name': 'volume-3370c176-0165-40e5-894f-59f3efd8ce5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '235f9fbb-28d4-4e7b-8eab-d4cb6a5917c6', 'enforce_multipath': True} {{(pid=86731) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:52:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-9d162e11-56e2-485a-abeb-ac4381a85e2c req-416dfa10-8a35-4e93-a0fe-4cee92cfc0c9 tempest-TestShelveInstance-1511948023 None] attachment_update completed successfully. Nov 02 12:52:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:52:45 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:53:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-c67011e9-3489-4479-925d-91109860b3ba req-da4ccbb3-ac24-4e9e-b507-5367de14eee0 tempest-TestShelveInstance-1511948023 None] Terminate volume connection completed successfully. Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [req-c67011e9-3489-4479-925d-91109860b3ba req-da4ccbb3-ac24-4e9e-b507-5367de14eee0 tempest-TestShelveInstance-1511948023 None] Deleting attachment 235f9fbb-28d4-4e7b-8eab-d4cb6a5917c6. {{(pid=86731) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Acquiring lock "cinder-3370c176-0165-40e5-894f-59f3efd8ce5d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "cinder-3370c176-0165-40e5-894f-59f3efd8ce5d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Acquiring lock "cinder-quobyte-3370c176-0165-40e5-894f-59f3efd8ce5d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "cinder-quobyte-3370c176-0165-40e5-894f-59f3efd8ce5d" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db20cc-9d54-4a1c-968e-4794c894cd2b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:18 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d Nov 02 12:53:18 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:19 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:19 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d Nov 02 12:53:19 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:19 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3370c176-0165-40e5-894f-59f3efd8ce5d" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "cinder-quobyte-3370c176-0165-40e5-894f-59f3efd8ce5d" released by "delete_volume" :: held 0.706s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG cinder.quota [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Created reservations ['adba02d2-a93e-4fa2-bdd1-64078025e1aa', '58e1a788-46dc-438b-a7b0-ad1fc975405a', '15e8636b-1d6d-4933-bf7e-6507042e2952', '0909e537-64e1-4d65-9851-4c675886f32d'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:19 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:19 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:20 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.275s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:20 devstack cinder-volume[86731]: DEBUG cinder.manager [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Deleted volume successfully. Nov 02 12:53:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [req-c67011e9-3489-4479-925d-91109860b3ba req-5b3ce6fe-d47a-49c5-95ec-071ae4815b1d tempest-TestShelveInstance-1511948023 None] Lock "cinder-3370c176-0165-40e5-894f-59f3efd8ce5d-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:28 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:29 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:29 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:53:29 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:53:30 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (c294b287-6c07-4b92-b7a0-e0eb47e0080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1fffd6-7697-45e5-80a9-5cdc3dc263b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1fffd6-7697-45e5-80a9-5cdc3dc263b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1984722159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aef229-3f29-4033-b348-2c7155a57587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:31Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e972ef-2d92-4e53-8643-e90c781c7119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e972ef-2d92-4e53-8643-e90c781c7119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff51739-f0f6-4258-a868-ee2f60d451ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff51739-f0f6-4258-a868-ee2f60d451ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aef229-3f29-4033-b348-2c7155a57587', 'volume_name': 'volume-f9aef229-3f29-4033-b348-2c7155a57587', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd65a3c-84fb-4da1-8b64-7b1aeebb4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd65a3c-84fb-4da1-8b64-7b1aeebb4854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade23b81-48da-4b9f-a162-2960f128e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Volume f9aef229-3f29-4033-b348-2c7155a57587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aef229-3f29-4033-b348-2c7155a57587', 'volume_size': 1} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1984722159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aef229-3f29-4033-b348-2c7155a57587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:31Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Creating volume f9aef229-3f29-4033-b348-2c7155a57587 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:31 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 1073741824 Nov 02 12:53:31 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (1e28347f-ab7c-430a-806d-a0a73c606313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005bb6df-c6fa-48fe-b77f-8e6d94b7ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005bb6df-c6fa-48fe-b77f-8e6d94b7ba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062170087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f3e6a8-b6d6-4813-a452-3172d8722602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d98c392-3e43-4bdb-8c70-0599981f59dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d98c392-3e43-4bdb-8c70-0599981f59dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093b1d0-a90a-4c14-b462-137628054f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0093b1d0-a90a-4c14-b462-137628054f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f3e6a8-b6d6-4813-a452-3172d8722602', 'volume_name': 'volume-e6f3e6a8-b6d6-4813-a452-3172d8722602', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cba28df-9aff-4425-8635-543b46805f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cba28df-9aff-4425-8635-543b46805f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eaccb0-cd8e-4b82-bd0c-8d2d807c0c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Volume e6f3e6a8-b6d6-4813-a452-3172d8722602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f3e6a8-b6d6-4813-a452-3172d8722602', 'volume_size': 1} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:31 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 1073741824" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:31 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 Nov 02 12:53:31 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (eabf9d5e-c877-44f3-9d14-ae02057451ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671c5b43-9b50-4334-be96-b945538977fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671c5b43-9b50-4334-be96-b945538977fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-182347800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6b5be1-91f1-49e9-bd7b-4967df87e916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c517a2-1921-4912-a0a7-d0f4b0f8e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c517a2-1921-4912-a0a7-d0f4b0f8e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d6e3ee-569f-4a1e-8f1e-c1fc91e535bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d6e3ee-569f-4a1e-8f1e-c1fc91e535bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6b5be1-91f1-49e9-bd7b-4967df87e916', 'volume_name': 'volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f25690-f2b0-482e-ab96-dbd7a6218751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f25690-f2b0-482e-ab96-dbd7a6218751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8289096a-e553-45ca-b219-cca8a8cc31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Volume 2f6b5be1-91f1-49e9-bd7b-4967df87e916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916', 'volume_size': 1} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:32 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2062170087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f3e6a8-b6d6-4813-a452-3172d8722602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Creating volume e6f3e6a8-b6d6-4813-a452-3172d8722602 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade23b81-48da-4b9f-a162-2960f128e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aef229-3f29-4033-b348-2c7155a57587', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2306011e-87bc-4eb4-812d-13484801a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 1073741824 Nov 02 12:53:32 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Volume volume-f9aef229-3f29-4033-b348-2c7155a57587 (f9aef229-3f29-4033-b348-2c7155a57587): created successfully Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2306011e-87bc-4eb4-812d-13484801a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (c294b287-6c07-4b92-b7a0-e0eb47e0080e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-550c6b3f-de42-4ed8-b243-adabdc639ec6 tempest-CreateVolumesFromImageTest-658663136 None] Created volume successfully. Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (452c9936-ccdb-4293-ac71-8c7a1e29df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ea978-5867-480d-94fb-be684927b332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748ea978-5867-480d-94fb-be684927b332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488390197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f439f6-16b6-43db-bc16-6bdd703a2086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a56e3-80c0-46ca-8d7b-67a6e59f7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a56e3-80c0-46ca-8d7b-67a6e59f7498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dd3336-e417-426c-9dab-d00ebac08438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dd3336-e417-426c-9dab-d00ebac08438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f439f6-16b6-43db-bc16-6bdd703a2086', 'volume_name': 'volume-47f439f6-16b6-43db-bc16-6bdd703a2086', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bf8eca-fffe-4633-9d1f-cb6457aa3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98bf8eca-fffe-4633-9d1f-cb6457aa3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf94fa8b-49f9-4376-ac28-8729b4903d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Volume 47f439f6-16b6-43db-bc16-6bdd703a2086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f439f6-16b6-43db-bc16-6bdd703a2086', 'volume_size': 1} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:32 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 1073741824" returned: 0 in 0.519s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:32 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 Nov 02 12:53:32 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (31386d70-f2bc-43fc-9838-578ee055f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fabb82-d25c-4ef8-aca3-a981befc5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fabb82-d25c-4ef8-aca3-a981befc5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1822039875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc7e0c8-04cd-43f3-9391-c8ff651f733e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:33Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef162bb5-0239-47a8-ace2-9471a86ed264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef162bb5-0239-47a8-ace2-9471a86ed264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf344f4d-5143-416e-b82d-902927b51eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf344f4d-5143-416e-b82d-902927b51eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc7e0c8-04cd-43f3-9391-c8ff651f733e', 'volume_name': 'volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c980f42a-99da-4f0a-9d2b-abb64efb22d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c980f42a-99da-4f0a-9d2b-abb64efb22d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd1bf68-81a5-4187-84df-802cba39a09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Volume 8dc7e0c8-04cd-43f3-9391-c8ff651f733e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e', 'volume_size': 1} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:32 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-182347800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6b5be1-91f1-49e9-bd7b-4967df87e916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Creating volume 2f6b5be1-91f1-49e9-bd7b-4967df87e916 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eaccb0-cd8e-4b82-bd0c-8d2d807c0c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f3e6a8-b6d6-4813-a452-3172d8722602', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:33 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 1073741824 Nov 02 12:53:33 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54711e9-987f-40ff-b9b7-cc7e8c0f63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Volume volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 (e6f3e6a8-b6d6-4813-a452-3172d8722602): created successfully Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54711e9-987f-40ff-b9b7-cc7e8c0f63ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (1e28347f-ab7c-430a-806d-a0a73c606313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-81995569-4c89-4c6e-8b7c-ead0be217a60 tempest-CreateVolumesFromImageTest-658663136 None] Created volume successfully. Nov 02 12:53:33 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 1073741824" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:33 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 Nov 02 12:53:33 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:33 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488390197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f439f6-16b6-43db-bc16-6bdd703a2086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:32Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Creating volume 47f439f6-16b6-43db-bc16-6bdd703a2086 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:33 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 1073741824 Nov 02 12:53:33 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8289096a-e553-45ca-b219-cca8a8cc31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3017d-1ae4-47cd-a710-82d01c701df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Volume volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 (2f6b5be1-91f1-49e9-bd7b-4967df87e916): created successfully Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3017d-1ae4-47cd-a710-82d01c701df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (eabf9d5e-c877-44f3-9d14-ae02057451ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a69d8364-7ae3-4d61-af54-3e9e36600f41 tempest-CreateVolumesFromImageTest-658663136 None] Created volume successfully. Nov 02 12:53:34 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 1073741824" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:34 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 Nov 02 12:53:34 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:34 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1822039875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc7e0c8-04cd-43f3-9391-c8ff651f733e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d13b9a0921b4202a4a2d23faf8fc938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:33Z,use_quota=True,user_id='9b6117d91a1b47e5b559ebc0759a3248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Creating volume 8dc7e0c8-04cd-43f3-9391-c8ff651f733e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:34 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf94fa8b-49f9-4376-ac28-8729b4903d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f439f6-16b6-43db-bc16-6bdd703a2086', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:34 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e 1073741824 Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3c5efe-70ab-47f8-9aa3-36bdbe895de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:34 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Volume volume-47f439f6-16b6-43db-bc16-6bdd703a2086 (47f439f6-16b6-43db-bc16-6bdd703a2086): created successfully Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3c5efe-70ab-47f8-9aa3-36bdbe895de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (452c9936-ccdb-4293-ac71-8c7a1e29df8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0546b752-75fc-4c7d-904d-3fb85e2d538f tempest-CreateVolumesFromImageTest-658663136 None] Created volume successfully. Nov 02 12:53:34 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e 1073741824" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:34 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e Nov 02 12:53:34 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:35 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd1bf68-81a5-4187-84df-802cba39a09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e156ae52-fb7c-4b28-b0de-f72d6e9e57ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Volume volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e (8dc7e0c8-04cd-43f3-9391-c8ff651f733e): created successfully Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e156ae52-fb7c-4b28-b0de-f72d6e9e57ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Flow 'volume_create_manager' (31386d70-f2bc-43fc-9838-578ee055f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b4f13296-61ef-4f94-8f53-33818350d9f1 tempest-CreateVolumesFromImageTest-658663136 None] Created volume successfully. Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-8dc7e0c8-04cd-43f3-9391-c8ff651f733e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-8dc7e0c8-04cd-43f3-9391-c8ff651f733e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-quobyte-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e28bc0-b841-4b93-970d-d719ed2b80a1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:36 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e Nov 02 12:53:36 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:36 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:36 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e Nov 02 12:53:36 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:36 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-8dc7e0c8-04cd-43f3-9391-c8ff651f733e" released by "delete_volume" :: held 0.643s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Created reservations ['4dd0e5e3-edf8-4403-bfc8-f61d7f21bb3f', '8cacb99c-c00f-45cc-8247-fca1b6e693b1', '03cfdf41-464b-46f1-9876-dcf2db6693c6', '22083f64-7190-4cbf-b781-2d32b2629385'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:36 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:36 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:37 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Deleted volume successfully. Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-adfdce30-3ee2-4d2c-be47-1bf4299eee57 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-8dc7e0c8-04cd-43f3-9391-c8ff651f733e-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-47f439f6-16b6-43db-bc16-6bdd703a2086-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-47f439f6-16b6-43db-bc16-6bdd703a2086-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-quobyte-47f439f6-16b6-43db-bc16-6bdd703a2086" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-47f439f6-16b6-43db-bc16-6bdd703a2086" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffff0c9-b0bd-44c5-b44a-de206fca13d7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:37 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 Nov 02 12:53:37 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:37 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:37 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086 Nov 02 12:53:37 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:37 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-47f439f6-16b6-43db-bc16-6bdd703a2086" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-47f439f6-16b6-43db-bc16-6bdd703a2086" released by "delete_volume" :: held 0.642s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Created reservations ['6943af60-eadb-4c3b-9544-daf8803360df', '917f1f49-390e-4a27-ad56-d3021a5b2f3e', 'bb1d78b7-1f70-43b0-aa7d-600e59447071', '508d6df8-80a5-44be-87a7-d940713a0903'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:38 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:38 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:38 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Deleted volume successfully. Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c3f38a7d-7869-4e2b-ace9-a78c62d819eb tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-47f439f6-16b6-43db-bc16-6bdd703a2086-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-2f6b5be1-91f1-49e9-bd7b-4967df87e916-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-2f6b5be1-91f1-49e9-bd7b-4967df87e916-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-quobyte-2f6b5be1-91f1-49e9-bd7b-4967df87e916" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-2f6b5be1-91f1-49e9-bd7b-4967df87e916" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44bef6-10f8-46cd-8f6c-13e3ee62cf6f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:38 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 Nov 02 12:53:38 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:38 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:38 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916 Nov 02 12:53:38 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:39 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2f6b5be1-91f1-49e9-bd7b-4967df87e916" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-2f6b5be1-91f1-49e9-bd7b-4967df87e916" released by "delete_volume" :: held 0.652s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Created reservations ['3f47f394-edc8-4199-84b2-0bbe2fbf9e33', 'e3a3247f-ce83-4577-bf15-e013f9c129db', 'b37fd99b-8b39-4b7d-b984-4e8f3f05638f', '8fb149c1-d70e-4088-9dda-4ba12fc067c5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:39 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:39 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:39 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.236s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Deleted volume successfully. Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d6e4fc74-1d91-4d75-936a-0fd41417bc10 tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-2f6b5be1-91f1-49e9-bd7b-4967df87e916-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-e6f3e6a8-b6d6-4813-a452-3172d8722602-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-e6f3e6a8-b6d6-4813-a452-3172d8722602-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-quobyte-e6f3e6a8-b6d6-4813-a452-3172d8722602" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-e6f3e6a8-b6d6-4813-a452-3172d8722602" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[991200de-31c2-454c-91c0-4c3bb7df6adc]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:39 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 Nov 02 12:53:39 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:40 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602" returned: 0 in 0.375s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:40 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602 Nov 02 12:53:40 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:40 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e6f3e6a8-b6d6-4813-a452-3172d8722602" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-e6f3e6a8-b6d6-4813-a452-3172d8722602" released by "delete_volume" :: held 0.661s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Created reservations ['c9f6b8ae-0b99-4f9b-893b-d7ed519af84a', '72027257-1330-4b2d-9dd2-8c864f0e367a', '1ba11c08-ed0a-4eb2-9789-f6543b0289d9', '0caa10ed-0da2-40a9-b7d2-5c05bc975a02'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:40 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:40 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:40 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Deleted volume successfully. Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b74fcf38-0692-4e9b-891e-d8cf096063bd tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-e6f3e6a8-b6d6-4813-a452-3172d8722602-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-f9aef229-3f29-4033-b348-2c7155a57587-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-f9aef229-3f29-4033-b348-2c7155a57587-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "cinder-quobyte-f9aef229-3f29-4033-b348-2c7155a57587" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-f9aef229-3f29-4033-b348-2c7155a57587" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293d408-398a-47b1-b19e-96259629647a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:41 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 Nov 02 12:53:41 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:41 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:41 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587 Nov 02 12:53:41 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:41 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f9aef229-3f29-4033-b348-2c7155a57587" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-quobyte-f9aef229-3f29-4033-b348-2c7155a57587" released by "delete_volume" :: held 0.625s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Created reservations ['c56083de-7236-4789-94b8-813311ace1ad', '560fbcf4-7223-4af9-ab49-8bdd1f4a38ee', 'cbc9aa29-a55e-4c26-aa74-f5fcffc73989', '7c8caa3e-b090-4a9a-b3f1-af59a05900c4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:41 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:41 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:41 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Deleted volume successfully. Nov 02 12:53:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6799bbdc-503d-4564-80d0-092292132a7b tempest-CreateVolumesFromImageTest-658663136 None] Lock "cinder-f9aef229-3f29-4033-b348-2c7155a57587-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (4ee4a3c8-552a-4a57-a8a8-df44a3e9fa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a01f7e-c3b6-4601-8ba4-066eace16730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a01f7e-c3b6-4601-8ba4-066eace16730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222762517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b41cac-9676-47e2-8094-76aa06af95c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:45Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe08aee2-d0e7-4eb0-a00a-8bd2fea907fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe08aee2-d0e7-4eb0-a00a-8bd2fea907fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a20f3db-41c1-47f2-b65e-b4eafa903b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a20f3db-41c1-47f2-b65e-b4eafa903b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b41cac-9676-47e2-8094-76aa06af95c1', 'volume_name': 'volume-66b41cac-9676-47e2-8094-76aa06af95c1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc86bbf9-5671-451d-ab8e-5f94bb24bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc86bbf9-5671-451d-ab8e-5f94bb24bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38906669-e1b7-4268-9256-960f6be0abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:44 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 66b41cac-9676-47e2-8094-76aa06af95c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b41cac-9676-47e2-8094-76aa06af95c1', 'volume_size': 1} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222762517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b41cac-9676-47e2-8094-76aa06af95c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:45Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:44 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:44 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 1073741824 Nov 02 12:53:44 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:45 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 1073741824" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:45 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 Nov 02 12:53:45 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:45 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1" returned: 0 in 0.246s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38906669-e1b7-4268-9256-960f6be0abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b41cac-9676-47e2-8094-76aa06af95c1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37123fe8-2d87-4f33-88b8-a6fda8fa21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:45 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-66b41cac-9676-47e2-8094-76aa06af95c1 (66b41cac-9676-47e2-8094-76aa06af95c1): created successfully Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37123fe8-2d87-4f33-88b8-a6fda8fa21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (4ee4a3c8-552a-4a57-a8a8-df44a3e9fa98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a1b7c689-696b-4f4a-b763-1b6f75561ecc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating offline snapshot 33af7b2b-79a4-40db-8f07-54ac14b65372 of volume 66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[974897a2-a806-4bbb-87d4-e4d2f043ba00]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:45 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 Nov 02 12:53:45 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:46 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1" returned: 0 in 0.361s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:46 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 1G Nov 02 12:53:46 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:46 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 1G" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b41cac-9676-47e2-8094-76aa06af95c1 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:46 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b41cac-9676-47e2-8094-76aa06af95c1 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 Nov 02 12:53:46 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:46 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66b41cac-9676-47e2-8094-76aa06af95c1 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:46 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 is being set with open permissions: ugo+rw Nov 02 12:53:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:46 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 Nov 02 12:53:46 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:47 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:47 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info Nov 02 12:53:47 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:47 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:47 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info is being set with open permissions: ugo+rw Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:47 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info Nov 02 12:53:47 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:47 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.info" returned: 0 in 0.245s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fc91fadf-beb7-4351-86c8-f6154a382dab tempest-CreateVolumesFromSnapshotTest-2042757912 None] Create snapshot completed successfully Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (69b0705d-c901-4844-98e0-3f2a808ad491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecec4ba-89a6-43ad-b9eb-e6ada69a2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecec4ba-89a6-43ad-b9eb-e6ada69a2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917570639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b98330e-7f9a-40f4-9f56-6b3c251d82b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:48Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eff5ba-e35a-4f9f-bbcd-7e91a76fdb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25eff5ba-e35a-4f9f-bbcd-7e91a76fdb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eee5527-b89a-41f8-bf18-099add2ff7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eee5527-b89a-41f8-bf18-099add2ff7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b98330e-7f9a-40f4-9f56-6b3c251d82b3', 'volume_name': 'volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0787695e-7ff2-49c0-914d-08260cf7953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0787695e-7ff2-49c0-914d-08260cf7953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec251c40-ccff-4aa1-9585-d267aae31fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 9b98330e-7f9a-40f4-9f56-6b3c251d82b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3', 'volume_size': 1} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917570639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b98330e-7f9a-40f4-9f56-6b3c251d82b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:48Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 9b98330e-7f9a-40f4-9f56-6b3c251d82b3 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:48 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:48 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 1073741824 Nov 02 12:53:48 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (bf213fb9-ecbf-48fa-b853-011ecfa48843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41973516-4868-4a3c-908c-37bc4c317951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41973516-4868-4a3c-908c-37bc4c317951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1827628872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3689db00-357c-43c4-aa66-de3afe4d5bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3a69e1-4619-4f9c-b6b8-99146de78ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3a69e1-4619-4f9c-b6b8-99146de78ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774aa6cf-fb76-43bf-85fe-56cf5c06786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774aa6cf-fb76-43bf-85fe-56cf5c06786e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3689db00-357c-43c4-aa66-de3afe4d5bee', 'volume_name': 'volume-3689db00-357c-43c4-aa66-de3afe4d5bee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10491b9-cbb4-45b9-b6be-e9cd4813fed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10491b9-cbb4-45b9-b6be-e9cd4813fed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2914e6d6-37e0-4a94-a1b4-d439f01cdd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 3689db00-357c-43c4-aa66-de3afe4d5bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3689db00-357c-43c4-aa66-de3afe4d5bee', 'volume_size': 1} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:48 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 1073741824" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:49 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 Nov 02 12:53:49 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (56543985-e2ff-42b5-9b2c-ceffceeec21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7087a129-aae9-4a40-af22-9bfdc4131b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7087a129-aae9-4a40-af22-9bfdc4131b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990031312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918249bd-93a9-47d2-bbf9-aa33f3578e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870b958f-313e-4597-ae37-bdada8ffb0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870b958f-313e-4597-ae37-bdada8ffb0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ade79d-5d82-4607-ab36-2b2af1d38f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ade79d-5d82-4607-ab36-2b2af1d38f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918249bd-93a9-47d2-bbf9-aa33f3578e41', 'volume_name': 'volume-918249bd-93a9-47d2-bbf9-aa33f3578e41', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e70926-f1b8-439b-85b8-dba4bf061de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e70926-f1b8-439b-85b8-dba4bf061de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327c3ca2-baec-4824-8c8a-dfe717fb3c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 918249bd-93a9-47d2-bbf9-aa33f3578e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918249bd-93a9-47d2-bbf9-aa33f3578e41', 'volume_size': 1} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:49 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1827628872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3689db00-357c-43c4-aa66-de3afe4d5bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 3689db00-357c-43c4-aa66-de3afe4d5bee {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:49 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:49 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee 1073741824 Nov 02 12:53:49 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec251c40-ccff-4aa1-9585-d267aae31fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a492b31-4cf4-4116-924e-74e133952d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 (9b98330e-7f9a-40f4-9f56-6b3c251d82b3): created successfully Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a492b31-4cf4-4116-924e-74e133952d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (69b0705d-c901-4844-98e0-3f2a808ad491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:49 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f90d9a7d-49cf-44ce-9332-8a4b46c938bb tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (294032de-4de3-47de-bd9a-64d619aff42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c38e7f3-e8a6-4776-a015-3e316ab7eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c38e7f3-e8a6-4776-a015-3e316ab7eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637905326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8400b8-6834-4bc6-b5af-1f344ad4b59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddcdab1-541b-40a0-80a2-b3d92a435444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddcdab1-541b-40a0-80a2-b3d92a435444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd62fd53-266d-4730-a01a-7db80213fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd62fd53-266d-4730-a01a-7db80213fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8400b8-6834-4bc6-b5af-1f344ad4b59f', 'volume_name': 'volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32602f3e-b13e-46ae-82f6-d571466468ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32602f3e-b13e-46ae-82f6-d571466468ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0015bb-cef6-4998-b468-db3f3b100c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 3a8400b8-6834-4bc6-b5af-1f344ad4b59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f', 'volume_size': 1} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:49 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee 1073741824" returned: 0 in 0.500s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:49 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee Nov 02 12:53:49 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (388f5f58-2001-4246-a5e9-36440a680c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f73a732-ec43-47d3-bfdf-f6b38ebe4023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f73a732-ec43-47d3-bfdf-f6b38ebe4023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632932912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558c059e-cc89-45f4-81b5-69688d3d20d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:50Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b840b1cd-360a-479b-ab14-048086111479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b840b1cd-360a-479b-ab14-048086111479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fa8108-a80f-4596-af02-e5916b64f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fa8108-a80f-4596-af02-e5916b64f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558c059e-cc89-45f4-81b5-69688d3d20d5', 'volume_name': 'volume-558c059e-cc89-45f4-81b5-69688d3d20d5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41bdf73-bb1e-4780-8ed1-541f814285a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41bdf73-bb1e-4780-8ed1-541f814285a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9969a03a-caa4-466c-8db4-7f74b3babe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume 558c059e-cc89-45f4-81b5-69688d3d20d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558c059e-cc89-45f4-81b5-69688d3d20d5', 'volume_size': 1} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:50 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1990031312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918249bd-93a9-47d2-bbf9-aa33f3578e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 918249bd-93a9-47d2-bbf9-aa33f3578e41 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2914e6d6-37e0-4a94-a1b4-d439f01cdd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3689db00-357c-43c4-aa66-de3afe4d5bee', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:50 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 1073741824 Nov 02 12:53:50 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5c8b4-88fc-410f-bea2-a8555ba7d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-3689db00-357c-43c4-aa66-de3afe4d5bee (3689db00-357c-43c4-aa66-de3afe4d5bee): created successfully Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5c8b4-88fc-410f-bea2-a8555ba7d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (bf213fb9-ecbf-48fa-b853-011ecfa48843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-55c34baf-138e-4a77-9d0b-b1307db62847 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:50 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 1073741824" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:50 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 Nov 02 12:53:50 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:50 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-637905326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8400b8-6834-4bc6-b5af-1f344ad4b59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:49Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 3a8400b8-6834-4bc6-b5af-1f344ad4b59f {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327c3ca2-baec-4824-8c8a-dfe717fb3c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918249bd-93a9-47d2-bbf9-aa33f3578e41', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:50 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f 1073741824 Nov 02 12:53:50 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0574f41d-68a9-4080-a460-9fa95c00a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 (918249bd-93a9-47d2-bbf9-aa33f3578e41): created successfully Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0574f41d-68a9-4080-a460-9fa95c00a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (56543985-e2ff-42b5-9b2c-ceffceeec21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:50 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-005e39ea-6a5b-4d4e-bf5f-2e74db17aa33 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:51 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f 1073741824" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:51 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f Nov 02 12:53:51 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:51 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632932912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558c059e-cc89-45f4-81b5-69688d3d20d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b445a6abea940e885e270364da97b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:53:50Z,use_quota=True,user_id='f3dbd5aa2742460ab84159b97f12f4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Creating volume 558c059e-cc89-45f4-81b5-69688d3d20d5 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:53:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:51 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 1073741824 Nov 02 12:53:51 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0015bb-cef6-4998-b468-db3f3b100c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2163b732-d575-461e-a44d-209590d9261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:51 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f (3a8400b8-6834-4bc6-b5af-1f344ad4b59f): created successfully Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2163b732-d575-461e-a44d-209590d9261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (294032de-4de3-47de-bd9a-64d619aff42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-85fbd6da-dc0d-4df8-9c15-0531e247446a tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:51 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 1073741824" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:51 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 Nov 02 12:53:51 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:52 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5" returned: 0 in 0.237s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9969a03a-caa4-466c-8db4-7f74b3babe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558c059e-cc89-45f4-81b5-69688d3d20d5', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9baab0-e098-4fac-94a8-dc5d93d03496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:53:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Volume volume-558c059e-cc89-45f4-81b5-69688d3d20d5 (558c059e-cc89-45f4-81b5-69688d3d20d5): created successfully Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9baab0-e098-4fac-94a8-dc5d93d03496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:53:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Flow 'volume_create_manager' (388f5f58-2001-4246-a5e9-36440a680c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:53:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8aeb082c-c294-408c-b78d-0b6198ce2ea2 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created volume successfully. Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-558c059e-cc89-45f4-81b5-69688d3d20d5-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-558c059e-cc89-45f4-81b5-69688d3d20d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-558c059e-cc89-45f4-81b5-69688d3d20d5" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-558c059e-cc89-45f4-81b5-69688d3d20d5" acquired by "delete_volume" :: waited 0.012s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[09edc555-3a9a-468a-a0d0-0e317f76e55e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:53 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 Nov 02 12:53:53 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:53 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:53 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5 Nov 02 12:53:53 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:53 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-558c059e-cc89-45f4-81b5-69688d3d20d5" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:53 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-558c059e-cc89-45f4-81b5-69688d3d20d5" released by "delete_volume" :: held 0.623s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['a2d0f416-bad9-466f-a94e-8392c71b644c', '5a03c125-6691-4750-9a49-69aa36d0f354', '713d6ab5-ddf6-4330-bbdc-3eb4270269cd', 'c98e0733-fcc8-4008-9389-283cadff88b3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:54 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:54 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:54 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.234s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-274936d4-ce5a-4cb8-bbaa-f9c6c8f297bc tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-558c059e-cc89-45f4-81b5-69688d3d20d5-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-3a8400b8-6834-4bc6-b5af-1f344ad4b59f-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-3a8400b8-6834-4bc6-b5af-1f344ad4b59f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe0fab-884e-4483-b995-aeee9a964e67]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:54 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f Nov 02 12:53:54 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:54 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:54 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f Nov 02 12:53:54 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:55 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" returned: 0 in 0.259s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-3a8400b8-6834-4bc6-b5af-1f344ad4b59f" released by "delete_volume" :: held 0.667s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['c3f2dadd-ceed-428d-9ce3-5d96d91691ac', '8e197093-0b00-4a76-a13d-7ec1c57d4cdc', '27a6ab51-a2de-4ead-a2ee-376c4720cc2f', '611191d2-0c5c-4203-a1f4-6cac0be3635e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:55 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:55 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:55 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.252s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-42795b12-2e97-40b6-86dc-874667593305 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-3a8400b8-6834-4bc6-b5af-1f344ad4b59f-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-918249bd-93a9-47d2-bbf9-aa33f3578e41-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-918249bd-93a9-47d2-bbf9-aa33f3578e41-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-918249bd-93a9-47d2-bbf9-aa33f3578e41" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-918249bd-93a9-47d2-bbf9-aa33f3578e41" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccaf5aa-cbd6-4102-a244-1ca43fbbabe7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:55 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 Nov 02 12:53:55 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:56 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:56 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41 Nov 02 12:53:56 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:56 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-918249bd-93a9-47d2-bbf9-aa33f3578e41" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-918249bd-93a9-47d2-bbf9-aa33f3578e41" released by "delete_volume" :: held 0.646s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['b867d1d6-ec47-4170-9b2d-a29b7100b414', '2694695a-f165-4c3c-944f-85d365f6ea31', '20f5c406-847d-4e55-9897-b08cf7367c12', '215c8b80-920b-43f9-8058-457269d43098'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:56 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:56 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:56 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb254ff9-6be2-4476-9238-2d686551ebaf tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-918249bd-93a9-47d2-bbf9-aa33f3578e41-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-3689db00-357c-43c4-aa66-de3afe4d5bee-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-3689db00-357c-43c4-aa66-de3afe4d5bee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-3689db00-357c-43c4-aa66-de3afe4d5bee" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-3689db00-357c-43c4-aa66-de3afe4d5bee" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7d816-ae0b-4ad6-96e1-f27c6da8b140]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:56 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee Nov 02 12:53:56 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:57 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee" returned: 0 in 0.346s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:57 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee Nov 02 12:53:57 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:57 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3689db00-357c-43c4-aa66-de3afe4d5bee" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-3689db00-357c-43c4-aa66-de3afe4d5bee" released by "delete_volume" :: held 0.613s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['b3e7b20a-4da3-4372-a1da-9a3cb73813ee', '7653ae74-73e9-49e3-8584-c3ca87984f81', '270a2954-ef93-45a1-b81d-ba13250b87a8', '05cfa34e-6932-44f0-8df4-e79072260e3b'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:57 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:57 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:57 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b7a18c3-420f-4089-a82b-bc9a6f31de63 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-3689db00-357c-43c4-aa66-de3afe4d5bee-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-9b98330e-7f9a-40f4-9f56-6b3c251d82b3-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-9b98330e-7f9a-40f4-9f56-6b3c251d82b3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33f9a2-ffd0-4acc-8e39-1a312ec9b45e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:58 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 Nov 02 12:53:58 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:58 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:58 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3 Nov 02 12:53:58 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:58 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" returned: 0 in 0.231s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-9b98330e-7f9a-40f4-9f56-6b3c251d82b3" released by "delete_volume" :: held 0.612s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['c31f613d-5038-4d41-8c38-1da2f00a1f14', '885b2640-6a30-4e09-a30a-67d3a639c934', '77c6c2fa-2707-46d4-b3c8-d1c7a99d0231', '1db2d432-4c78-414a-a7a4-9bc50e9039b9'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:58 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:53:58 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:58 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.254s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:53:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:53:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d0546940-e358-411b-ac17-0e16adce1493 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-9b98330e-7f9a-40f4-9f56-6b3c251d82b3-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-33af7b2b-79a4-40db-8f07-54ac14b65372-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-33af7b2b-79a4-40db-8f07-54ac14b65372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-33af7b2b-79a4-40db-8f07-54ac14b65372" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-33af7b2b-79a4-40db-8f07-54ac14b65372" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleting offline snapshot 33af7b2b-79a4-40db-8f07-54ac14b65372 of volume 66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] snapshot_file for this snap is: volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab30453-2d3e-46bf-b720-2ec08e896d46]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:59 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 Nov 02 12:53:59 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:59 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66b41cac-9676-47e2-8094-76aa06af95c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[55615404-f4a4-43bb-b242-bc30a161b220]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:59 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 Nov 02 12:53:59 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:53:59 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:53:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:53:59 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 Nov 02 12:53:59 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:00 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:00 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372 Nov 02 12:54:00 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:00 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1.33af7b2b-79a4-40db-8f07-54ac14b65372" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-33af7b2b-79a4-40db-8f07-54ac14b65372" released by "_delete_snapshot" :: held 1.380s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" released by "delete_snapshot" :: held 1.403s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['a1e861ec-30ad-4b94-be35-95d973eaae26', '3681b4e8-7630-4ef1-8284-1cde89999b73', 'a142def2-bc41-4bad-a485-1a3ec4eb8f47', '8c20ee57-50ec-4c69-aa8c-a9bf1d49507a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Delete snapshot completed successfully. Nov 02 12:54:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-11ff1e34-ff9f-4c0e-b667-9d46c3d5a0d1 tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-33af7b2b-79a4-40db-8f07-54ac14b65372-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-66b41cac-9676-47e2-8094-76aa06af95c1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-66b41cac-9676-47e2-8094-76aa06af95c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e5fc7-34ac-4d80-961e-91917f61dc27]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:01 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 Nov 02 12:54:01 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:01 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1" returned: 0 in 0.359s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:01 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1 Nov 02 12:54:01 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:01 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-66b41cac-9676-47e2-8094-76aa06af95c1" returned: 0 in 0.234s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-quobyte-66b41cac-9676-47e2-8094-76aa06af95c1" released by "delete_volume" :: held 0.656s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Created reservations ['86fac44c-10d1-44d6-a71a-94c3ac2c0f1c', '8bfc4c51-db81-4ebf-88c6-60857a627c8a', 'f4261402-fb61-452f-b26e-96d466a52e88', '072d5937-77a9-4632-82ec-6b8b51215a6f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:02 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:02 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:02 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Deleted volume successfully. Nov 02 12:54:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ceb6d64a-876d-47a7-a91c-44f8550de32b tempest-CreateVolumesFromSnapshotTest-2042757912 None] Lock "cinder-66b41cac-9676-47e2-8094-76aa06af95c1-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Flow 'volume_create_manager' (785f5e4b-9b56-44bc-9b65-a25a2a3969c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4dfc63b-8d4e-4f0c-800f-29d502d3bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4dfc63b-8d4e-4f0c-800f-29d502d3bb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551822360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6caeaeb-34d5-4571-a21e-ebd3df3d495b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b4200354dc45569638995ab68b36c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:06Z,use_quota=True,user_id='34b68e96f6d24339929ac30adf1e521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaffec3-1e57-41cd-b555-4ddb9c0d50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaffec3-1e57-41cd-b555-4ddb9c0d50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bdb980-e3ec-4422-a64b-a798eb0436e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bdb980-e3ec-4422-a64b-a798eb0436e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6caeaeb-34d5-4571-a21e-ebd3df3d495b', 'volume_name': 'volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79eeba9-0676-4dd5-9bdb-683d9f80f4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79eeba9-0676-4dd5-9bdb-683d9f80f4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390068b1-eba8-4acd-9cfd-2b25ade5fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Volume b6caeaeb-34d5-4571-a21e-ebd3df3d495b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b', 'volume_size': 1} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551822360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6caeaeb-34d5-4571-a21e-ebd3df3d495b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b4200354dc45569638995ab68b36c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:06Z,use_quota=True,user_id='34b68e96f6d24339929ac30adf1e521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Creating volume b6caeaeb-34d5-4571-a21e-ebd3df3d495b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:54:05 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:54:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:05 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b 1073741824 Nov 02 12:54:05 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:06 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b 1073741824" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:06 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b Nov 02 12:54:06 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:06 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390068b1-eba8-4acd-9cfd-2b25ade5fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c0381-1341-4cef-9b41-e18c03e24ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:06 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Volume volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b (b6caeaeb-34d5-4571-a21e-ebd3df3d495b): created successfully Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099c0381-1341-4cef-9b41-e18c03e24ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Flow 'volume_create_manager' (785f5e4b-9b56-44bc-9b65-a25a2a3969c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4079628d-2dc6-413f-a3f5-16cfaae4319b tempest-ProjectReaderTests-39884864 None] Created volume successfully. Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Acquiring lock "cinder-b6caeaeb-34d5-4571-a21e-ebd3df3d495b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "cinder-b6caeaeb-34d5-4571-a21e-ebd3df3d495b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Acquiring lock "cinder-quobyte-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "cinder-quobyte-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7da62-4600-41a0-8686-fb50a0584881]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:06 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b Nov 02 12:54:06 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:07 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" returned: 0 in 0.374s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:07 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b Nov 02 12:54:07 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:07 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "cinder-quobyte-b6caeaeb-34d5-4571-a21e-ebd3df3d495b" released by "delete_volume" :: held 0.664s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Created reservations ['d0ef797d-fe70-4391-bf66-329a287f51b7', 'accf110f-082a-4868-9250-37a135f98fdb', 'bb2264ac-2034-4077-bc01-ef922f4ee4f3', '970099b8-a200-4fa5-83a0-ee558be621d7'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:07 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:07 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:07 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Deleted volume successfully. Nov 02 12:54:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-5b61769d-995c-437f-9552-c3f5f2d600cd tempest-ProjectReaderTests-39884864 None] Lock "cinder-b6caeaeb-34d5-4571-a21e-ebd3df3d495b-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Flow 'volume_create_manager' (5f605776-b055-4fe2-9773-5de9e08b55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff038a3-198f-4e41-ad80-386155bbf605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff038a3-198f-4e41-ad80-386155bbf605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528324419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f56286c-670d-49c4-a8d2-471b66c2434b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b4200354dc45569638995ab68b36c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:08Z,use_quota=True,user_id='34b68e96f6d24339929ac30adf1e521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af539e3c-2b0b-4146-bc36-2432b6beed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af539e3c-2b0b-4146-bc36-2432b6beed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36fe20-dcc5-411b-a127-43a57c38ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36fe20-dcc5-411b-a127-43a57c38ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f56286c-670d-49c4-a8d2-471b66c2434b', 'volume_name': 'volume-5f56286c-670d-49c4-a8d2-471b66c2434b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e299175-a0aa-4756-9c5e-965f923e6f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e299175-a0aa-4756-9c5e-965f923e6f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31ce62b-2086-441e-bb5e-7ec0af69b83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Volume 5f56286c-670d-49c4-a8d2-471b66c2434b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f56286c-670d-49c4-a8d2-471b66c2434b', 'volume_size': 1} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528324419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f56286c-670d-49c4-a8d2-471b66c2434b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3b4200354dc45569638995ab68b36c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:08Z,use_quota=True,user_id='34b68e96f6d24339929ac30adf1e521b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Creating volume 5f56286c-670d-49c4-a8d2-471b66c2434b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:54:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:08 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b 1073741824 Nov 02 12:54:08 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:08 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b 1073741824" returned: 0 in 0.408s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:08 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b Nov 02 12:54:08 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:09 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31ce62b-2086-441e-bb5e-7ec0af69b83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f56286c-670d-49c4-a8d2-471b66c2434b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e60878-84a8-4339-b52e-16c7d57d018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Volume volume-5f56286c-670d-49c4-a8d2-471b66c2434b (5f56286c-670d-49c4-a8d2-471b66c2434b): created successfully Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e60878-84a8-4339-b52e-16c7d57d018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Flow 'volume_create_manager' (5f605776-b055-4fe2-9773-5de9e08b55dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1c4a741c-c5e9-49a8-a33c-b2aaec024603 tempest-ProjectReaderTests-39884864 None] Created volume successfully. Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Acquiring lock "cinder-5f56286c-670d-49c4-a8d2-471b66c2434b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "cinder-5f56286c-670d-49c4-a8d2-471b66c2434b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Acquiring lock "cinder-quobyte-5f56286c-670d-49c4-a8d2-471b66c2434b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "cinder-quobyte-5f56286c-670d-49c4-a8d2-471b66c2434b" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f8d90b-d080-4d8d-a048-8b70f2bb8e75]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:09 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b Nov 02 12:54:09 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:09 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b" returned: 0 in 0.355s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:09 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b Nov 02 12:54:09 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:10 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-5f56286c-670d-49c4-a8d2-471b66c2434b" returned: 0 in 0.237s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "cinder-quobyte-5f56286c-670d-49c4-a8d2-471b66c2434b" released by "delete_volume" :: held 0.631s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Created reservations ['5ec02485-5798-459b-bd84-e340f500d2c4', '3ca28d8f-6ead-4428-b7d4-3d50e38bb7f2', '59256f39-033d-404a-b8ce-158ca7a05e2b', '77611450-447c-4d17-ac15-036f9bbf4b85'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:10 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:10 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:10 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Deleted volume successfully. Nov 02 12:54:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ae76762-8d33-4bd9-8e2b-367ea810d3d5 tempest-ProjectReaderTests-39884864 None] Lock "cinder-5f56286c-670d-49c4-a8d2-471b66c2434b-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=108,cinder:UPDATE=145,cinder:DELETE=15,cinder:INSERT=37 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:54:20 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=156,cinder:INSERT=33,cinder:SELECT=93,cinder:DELETE=12 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:29 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:29 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:29 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:54:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:54:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Flow 'volume_create_manager' (fcb54af7-c920-496f-bbb5-8d119c200de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d1c578-776b-456b-b9f9-ac5e16122787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d1c578-776b-456b-b9f9-ac5e16122787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1701778181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8538e27-a443-46b5-ab7b-8433deb59c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a4f347fdac4096a2fb2a99088e3b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:31Z,use_quota=True,user_id='5faaf1152e074715896811517c5ef93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9feb271c-1a20-41be-a75f-20f23b8784d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9feb271c-1a20-41be-a75f-20f23b8784d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66bdae3-ae7e-476e-bece-e3ba44679679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66bdae3-ae7e-476e-bece-e3ba44679679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8538e27-a443-46b5-ab7b-8433deb59c51', 'volume_name': 'volume-e8538e27-a443-46b5-ab7b-8433deb59c51', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b1d054-6929-4ab9-84e9-b94f6ee02eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b1d054-6929-4ab9-84e9-b94f6ee02eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41d95af-d424-46cf-b657-ccfd2c56e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Volume e8538e27-a443-46b5-ab7b-8433deb59c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8538e27-a443-46b5-ab7b-8433deb59c51', 'volume_size': 1} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1701778181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8538e27-a443-46b5-ab7b-8433deb59c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a4f347fdac4096a2fb2a99088e3b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:31Z,use_quota=True,user_id='5faaf1152e074715896811517c5ef93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Creating volume e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:54:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:31 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 1073741824 Nov 02 12:54:31 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:31 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 1073741824" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:32 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:32 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:32 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41d95af-d424-46cf-b657-ccfd2c56e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8538e27-a443-46b5-ab7b-8433deb59c51', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1647595-ba50-44d6-bf3e-b2cea30ad211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Volume volume-e8538e27-a443-46b5-ab7b-8433deb59c51 (e8538e27-a443-46b5-ab7b-8433deb59c51): created successfully Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1647595-ba50-44d6-bf3e-b2cea30ad211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Flow 'volume_create_manager' (fcb54af7-c920-496f-bbb5-8d119c200de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-689a68ad-40a9-4b3e-ba47-385ce944d379 tempest-SnapshotDependencyTests-151993927 None] Created volume successfully. Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Creating offline snapshot 48352039-7d17-4633-96a8-11faf49ba834 of volume e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48325e-7307-41f2-a383-f5bbef03e03e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:32 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:32 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:33 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:33 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 1G Nov 02 12:54:33 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:33 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 1G" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8538e27-a443-46b5-ab7b-8433deb59c51 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:33 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8538e27-a443-46b5-ab7b-8433deb59c51 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:33 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:33 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8538e27-a443-46b5-ab7b-8433deb59c51 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.290s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 is being set with open permissions: ugo+rw Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:33 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:33 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:33 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:34 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info Nov 02 12:54:34 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:34 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:34 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info is being set with open permissions: ugo+rw Nov 02 12:54:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:34 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info Nov 02 12:54:34 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:34 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.info" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ebfbaae9-0796-4fa9-b1b7-341a7b2affb6 tempest-SnapshotDependencyTests-151993927 None] Create snapshot completed successfully Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Flow 'volume_create_manager' (8a17dcc8-7c96-46e3-9461-f5b55503331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d674f-913c-4a83-8d2d-f15bb9c34b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9d674f-913c-4a83-8d2d-f15bb9c34b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635ca737-431e-45d2-af99-1c7d146a7b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28a4f347fdac4096a2fb2a99088e3b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48352039-7d17-4633-96a8-11faf49ba834,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:54:35Z,use_quota=True,user_id='5faaf1152e074715896811517c5ef93a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcb21a-f2c2-41dd-bb4f-6c71eae5a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bcb21a-f2c2-41dd-bb4f-6c71eae5a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06daa71-3e68-4e94-b727-56f107fb1c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06daa71-3e68-4e94-b727-56f107fb1c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '635ca737-431e-45d2-af99-1c7d146a7b9a', 'volume_name': 'volume-635ca737-431e-45d2-af99-1c7d146a7b9a', 'volume_size': 1, 'snapshot_id': '48352039-7d17-4633-96a8-11faf49ba834'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569dc999-821c-49f9-927f-e4176c63b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569dc999-821c-49f9-927f-e4176c63b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c11339-0db6-40db-a206-46ece56ec4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Volume 635ca737-431e-45d2-af99-1c7d146a7b9a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-635ca737-431e-45d2-af99-1c7d146a7b9a', 'volume_size': 1, 'snapshot_id': '48352039-7d17-4633-96a8-11faf49ba834'} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834-635ca737-431e-45d2-af99-1c7d146a7b9a" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834-635ca737-431e-45d2-af99-1c7d146a7b9a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Creating volume 635ca737-431e-45d2-af99-1c7d146a7b9a from snapshot 48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] snapshot: 48352039-7d17-4633-96a8-11faf49ba834, volume: 635ca737-431e-45d2-af99-1c7d146a7b9a, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[876be8dd-6b25-48d1-8d79-410f31ff343b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:35 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:35 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:35 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8538e27-a443-46b5-ab7b-8433deb59c51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a9003-c5b4-4708-b9b8-ab312178bdc8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:35 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:35 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:36 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:54:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:54:36 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:54:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:36 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a Nov 02 12:54:36 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:41 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a" returned: 0 in 5.681s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:41 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:54:41 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Converted 1024.00 MB image at 180.22 MB/s Nov 02 12:54:41 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a is being set with open permissions: ugo+rw Nov 02 12:54:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:41 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a Nov 02 12:54:41 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:42 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a" returned: 0 in 0.230s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" released by "_copy_volume_from_snapshot" :: held 6.686s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834-635ca737-431e-45d2-af99-1c7d146a7b9a" released by "_create_volume_from_snapshot" :: held 6.742s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.756s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c11339-0db6-40db-a206-46ece56ec4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635ca737-431e-45d2-af99-1c7d146a7b9a', 'volume_size': 1, 'snapshot_id': '48352039-7d17-4633-96a8-11faf49ba834'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa1e70-8d35-46d1-9047-a3891abaa170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:54:42 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Volume volume-635ca737-431e-45d2-af99-1c7d146a7b9a (635ca737-431e-45d2-af99-1c7d146a7b9a): created successfully Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa1e70-8d35-46d1-9047-a3891abaa170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Flow 'volume_create_manager' (8a17dcc8-7c96-46e3-9461-f5b55503331c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:54:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-357adf6a-9234-43a1-bf18-de76961d0bf8 tempest-SnapshotDependencyTests-151993927 None] Created volume successfully. Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-48352039-7d17-4633-96a8-11faf49ba834-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-48352039-7d17-4633-96a8-11faf49ba834-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Deleting offline snapshot 48352039-7d17-4633-96a8-11faf49ba834 of volume e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] snapshot_file for this snap is: volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f420e10e-ce9a-4e58-8175-77f13e6ad6c6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:43 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:43 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:43 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8538e27-a443-46b5-ab7b-8433deb59c51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c238f2-6967-44cb-8fbb-05b3247c1230]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:43 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:43 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:43 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.511s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:43 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:43 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:44 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.321s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:44 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834 Nov 02 12:54:44 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:44 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51.48352039-7d17-4633-96a8-11faf49ba834" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-48352039-7d17-4633-96a8-11faf49ba834" released by "_delete_snapshot" :: held 1.517s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" released by "delete_snapshot" :: held 1.537s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Created reservations ['0dfc6461-11c4-4996-a5b2-e9a5a64b975f', '43a0ea63-dc6b-4d97-b489-059a4ae7ad3a', 'f3940bd0-aa4c-4ca0-a49d-c0fa74a67da0', '320e22d1-800c-44ca-aedd-a285fdd31712'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Delete snapshot completed successfully. Nov 02 12:54:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-51ffd17a-ce71-4586-bd10-5727db4a3192 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-48352039-7d17-4633-96a8-11faf49ba834-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-e8538e27-a443-46b5-ab7b-8433deb59c51-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-e8538e27-a443-46b5-ab7b-8433deb59c51-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[369804b1-470f-4dd4-a4b9-18701b1ccc3a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:45 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:45 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:45 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:45 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51 Nov 02 12:54:45 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:45 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e8538e27-a443-46b5-ab7b-8433deb59c51" returned: 0 in 0.256s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-e8538e27-a443-46b5-ab7b-8433deb59c51" released by "delete_volume" :: held 0.660s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Created reservations ['533d927f-0346-4717-bb2b-6b829f4bd402', '10ef9b9b-49fc-4761-b9ac-34f837a4931f', '4a79484f-5e53-4aab-99cf-24690a742ae1', '53f98baf-8b66-48b1-8159-9ab46b631dfb'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:45 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:45 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:46 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Deleted volume successfully. Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a96e736e-6cff-4493-a6c3-9647587d23c5 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-e8538e27-a443-46b5-ab7b-8433deb59c51-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-635ca737-431e-45d2-af99-1c7d146a7b9a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-635ca737-431e-45d2-af99-1c7d146a7b9a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f5ffc5-89ac-413d-909f-99a1170239cc]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:46 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a Nov 02 12:54:46 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:46 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a" returned: 0 in 0.341s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:46 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a Nov 02 12:54:46 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:46 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-635ca737-431e-45d2-af99-1c7d146a7b9a" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-quobyte-635ca737-431e-45d2-af99-1c7d146a7b9a" released by "delete_volume" :: held 0.623s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Created reservations ['2d77e7e6-3b41-4988-a58e-c7afd0622525', '5b993958-6e56-4950-ad17-5eed9cb93670', '7544e052-ad31-40c6-ad39-20d9b0a43984', '84ed0797-b04e-46aa-9eda-adde5746dc4b'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:54:47 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:54:47 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:54:47 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.229s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:54:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Deleted volume successfully. Nov 02 12:54:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-8ecb29c0-7099-4b51-90bc-b9634f294073 tempest-SnapshotDependencyTests-151993927 None] Lock "cinder-635ca737-431e-45d2-af99-1c7d146a7b9a-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:54:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:54:57 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Flow 'volume_create_manager' (4a5a267a-2e74-49e8-a6d6-4cb64124a4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8ccb8d-9714-402b-bff4-9e4b4a6ad1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8ccb8d-9714-402b-bff4-9e4b4a6ad1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1747766472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79d37e0-20bb-4f06-82dd-8901fe355383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09e89b378af484b99199c24a1beea75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:08Z,use_quota=True,user_id='d8d20df65266427d9a585623de918cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01e159c-942a-4be5-8094-99bf05927306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01e159c-942a-4be5-8094-99bf05927306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1c489b-b2bf-407a-bdf6-c09844cd83c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1c489b-b2bf-407a-bdf6-c09844cd83c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79d37e0-20bb-4f06-82dd-8901fe355383', 'volume_name': 'volume-a79d37e0-20bb-4f06-82dd-8901fe355383', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c62dfe3-621c-428e-b5ff-90a9ead97b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c62dfe3-621c-428e-b5ff-90a9ead97b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7132a66-b2ad-4469-b984-5a8772d1d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Volume a79d37e0-20bb-4f06-82dd-8901fe355383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79d37e0-20bb-4f06-82dd-8901fe355383', 'volume_size': 1} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1747766472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79d37e0-20bb-4f06-82dd-8901fe355383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09e89b378af484b99199c24a1beea75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:08Z,use_quota=True,user_id='d8d20df65266427d9a585623de918cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Creating volume a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:07 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:07 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 1073741824 Nov 02 12:55:07 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (c255d8ac-f8de-4a30-be1e-dfc33d5b6d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4ddbf2-950e-45d7-a5f3-81852dadb160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4ddbf2-950e-45d7-a5f3-81852dadb160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669954742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ebffc6-876a-4d07-8a69-2988365d3daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:08Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f26e64a-3ffe-4c24-b8a5-12b7a7327493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f26e64a-3ffe-4c24-b8a5-12b7a7327493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5dcd9-9c7f-46d4-bea8-00c7b029673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5dcd9-9c7f-46d4-bea8-00c7b029673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ebffc6-876a-4d07-8a69-2988365d3daf', 'volume_name': 'volume-67ebffc6-876a-4d07-8a69-2988365d3daf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b16069-9400-4c01-baaf-69375a1f4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b16069-9400-4c01-baaf-69375a1f4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05590fa4-ef3e-48c4-9f65-227d825288b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume 67ebffc6-876a-4d07-8a69-2988365d3daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ebffc6-876a-4d07-8a69-2988365d3daf', 'volume_size': 1} Nov 02 12:55:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:08 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 1073741824" returned: 0 in 0.532s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:08 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:08 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:08 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669954742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ebffc6-876a-4d07-8a69-2988365d3daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:08Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume 67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:08 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf 1073741824 Nov 02 12:55:08 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7132a66-b2ad-4469-b984-5a8772d1d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79d37e0-20bb-4f06-82dd-8901fe355383', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e24659-4f9f-48ca-a444-30e983cf8e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (ecdcfb75-efee-4918-aa74-2a0dcabcbc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13023afa-7c16-4bf7-896b-326f14df0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Volume volume-a79d37e0-20bb-4f06-82dd-8901fe355383 (a79d37e0-20bb-4f06-82dd-8901fe355383): created successfully Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e24659-4f9f-48ca-a444-30e983cf8e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Flow 'volume_create_manager' (4a5a267a-2e74-49e8-a6d6-4cb64124a4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13023afa-7c16-4bf7-896b-326f14df0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328774823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7906772-ae6b-408a-ada7-7935e5b1f6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:09Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6edc33d-c8ae-473e-ba7c-79b7abfefdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6edc33d-c8ae-473e-ba7c-79b7abfefdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79425d3-65ff-44d4-838d-a2bb18e8be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79425d3-65ff-44d4-838d-a2bb18e8be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7906772-ae6b-408a-ada7-7935e5b1f6b6', 'volume_name': 'volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef86a0c5-d803-410d-bd2c-846592e5ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef86a0c5-d803-410d-bd2c-846592e5ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb05454-18b3-4cf5-a62c-5ad7065878b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Volume c7906772-ae6b-408a-ada7-7935e5b1f6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6', 'volume_size': 1} Nov 02 12:55:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6295d657-bfd9-465b-be1a-e54016ba49f6 tempest-VolumeDependencyTests-456924521 None] Created volume successfully. Nov 02 12:55:09 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf 1073741824" returned: 0 in 0.468s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:09 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf Nov 02 12:55:09 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:09 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328774823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7906772-ae6b-408a-ada7-7935e5b1f6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:09Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Creating volume c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:09 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:09 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 1073741824 Nov 02 12:55:09 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05590fa4-ef3e-48c4-9f65-227d825288b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ebffc6-876a-4d07-8a69-2988365d3daf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039aedc2-c657-49b7-aa6f-4120f8d9ae3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-67ebffc6-876a-4d07-8a69-2988365d3daf (67ebffc6-876a-4d07-8a69-2988365d3daf): created successfully Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039aedc2-c657-49b7-aa6f-4120f8d9ae3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (c255d8ac-f8de-4a30-be1e-dfc33d5b6d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-18222d97-fd23-4b47-b6f2-a1f0a1e00aa2 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:10 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 1073741824" returned: 0 in 0.591s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:10 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 Nov 02 12:55:10 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:10 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.464s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb05454-18b3-4cf5-a62c-5ad7065878b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d375cee2-754f-47b8-8c2b-beab6b28952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Creating offline snapshot 5668d474-0d1a-4c46-b271-5c8b8c40ce70 of volume a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:55:10 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Volume volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 (c7906772-ae6b-408a-ada7-7935e5b1f6b6): created successfully Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d375cee2-754f-47b8-8c2b-beab6b28952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (ecdcfb75-efee-4918-aa74-2a0dcabcbc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf985a95-28e7-46a0-859a-0f79fa60abd7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b2806b2e-0acb-4d59-a7e1-0f2f9a98fdb1 tempest-ProjectReaderTests-1423558856 None] Created volume successfully. Nov 02 12:55:10 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:10 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:10 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:10 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 1G Nov 02 12:55:10 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:11 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 1G" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79d37e0-20bb-4f06-82dd-8901fe355383 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:11 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79d37e0-20bb-4f06-82dd-8901fe355383 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:11 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Flow 'volume_create_manager' (453baa79-a85e-4097-ad9d-bd766ed5357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1219162-08bf-40cc-81cc-8f385b2844c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1219162-08bf-40cc-81cc-8f385b2844c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd69737b-6126-4af2-a51c-71239cbaaefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f369016c4f4ad7b642fe139f43c193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:11Z,use_quota=True,user_id='2308abf9a75e489ba10eee62abacc871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69779a7e-db5a-4daa-b374-73308f52fd06),volume_type_id=69779a7e-db5a-4daa-b374-73308f52fd06)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de19e09f-e265-4721-b812-5f3c651ea695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de19e09f-e265-4721-b812-5f3c651ea695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7b2036-02b3-4904-b3ed-594b24cfeb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:55:11 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79d37e0-20bb-4f06-82dd-8901fe355383 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:11 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 is being set with open permissions: ugo+rw Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:11 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:11 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7b2036-02b3-4904-b3ed-594b24cfeb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd69737b-6126-4af2-a51c-71239cbaaefd', 'volume_name': 'volume-dd69737b-6126-4af2-a51c-71239cbaaefd', 'volume_size': 1, 'image_id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7badcd4b5cb48267810839f4fc7bb4de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f369016c4f4ad7b642fe139f43c193', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31d76896838d317d6a13afdc977cbac9c8efcd4f53127f1f3fef617a909ccdc2e58bfbc9ba56037eae50a65edc13371682da07fec977de8949fb37de15443d8a', 'id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'created_at': datetime.datetime(2026, 11, 2, 11, 55, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 55, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3219d4c5-23e3-40a6-9229-cf89d605514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3219d4c5-23e3-40a6-9229-cf89d605514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd183f2-5d54-48a6-8625-4254f2a81c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Volume dd69737b-6126-4af2-a51c-71239cbaaefd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd69737b-6126-4af2-a51c-71239cbaaefd', 'volume_size': 1, 'image_id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7badcd4b5cb48267810839f4fc7bb4de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f369016c4f4ad7b642fe139f43c193', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31d76896838d317d6a13afdc977cbac9c8efcd4f53127f1f3fef617a909ccdc2e58bfbc9ba56037eae50a65edc13371682da07fec977de8949fb37de15443d8a', 'id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'created_at': datetime.datetime(2026, 11, 2, 11, 55, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 55, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Trying to clone dd69737b-6126-4af2-a51c-71239cbaaefd from image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa at location (None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:55:11 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.257s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:55:11 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:11 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info Nov 02 12:55:11 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3546dc5-02af-4481-9c1e-706e3321c9a9]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:12 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:12 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:12 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info is being set with open permissions: ugo+rw Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info Nov 02 12:55:12 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:12 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:12 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:12 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.info" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.393s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating offline snapshot 9dae360f-52be-43ce-9e73-69e1350a2056 of volume 67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:55:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-57bd8524-277d-48ea-b858-b97bfd39bb3e tempest-VolumeDependencyTests-456924521 None] Create snapshot completed successfully Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9daf4-a308-4225-a28e-877028f1452e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf Nov 02 12:55:12 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:12 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 1 in 0.339s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Temporary image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa is fetched for user 2308abf9a75e489ba10eee62abacc871. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e4a79-dcbc-43ff-8dae-12910d97420c]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:12 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:12 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:12 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 1G Nov 02 12:55:12 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:13 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:13 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:13 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:13 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 1G" returned: 0 in 0.435s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ebffc6-876a-4d07-8a69-2988365d3daf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:13 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ebffc6-876a-4d07-8a69-2988365d3daf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 Nov 02 12:55:13 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:13 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:13 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ebffc6-876a-4d07-8a69-2988365d3daf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056" returned: 0 in 0.331s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:13 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 is being set with open permissions: ugo+rw Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:13 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 Nov 02 12:55:13 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Flow 'volume_create_manager' (edbc5ffb-1cb8-4f3e-b599-1efe7f9cdf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6350e6dc-f527-4d31-a673-4d4cef7dcd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6350e6dc-f527-4d31-a673-4d4cef7dcd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1552186301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5180b2e-a149-4b77-820b-e1682fef41c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09e89b378af484b99199c24a1beea75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5668d474-0d1a-4c46-b271-5c8b8c40ce70,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:14Z,use_quota=True,user_id='d8d20df65266427d9a585623de918cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e3dc1-a82a-4c74-b372-f532143ada64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88e3dc1-a82a-4c74-b372-f532143ada64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af3a19b-d95b-4f77-9891-228a4a85b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af3a19b-d95b-4f77-9891-228a4a85b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5180b2e-a149-4b77-820b-e1682fef41c6', 'volume_name': 'volume-b5180b2e-a149-4b77-820b-e1682fef41c6', 'volume_size': 1, 'snapshot_id': '5668d474-0d1a-4c46-b271-5c8b8c40ce70'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5babf885-1711-48b1-9fe9-5c892e9edba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5babf885-1711-48b1-9fe9-5c892e9edba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723ad226-91e9-4a5b-b25d-f9330484d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Volume b5180b2e-a149-4b77-820b-e1682fef41c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5180b2e-a149-4b77-820b-e1682fef41c6', 'volume_size': 1, 'snapshot_id': '5668d474-0d1a-4c46-b271-5c8b8c40ce70'} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:13 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:13 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info Nov 02 12:55:13 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:14 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info is being set with open permissions: ugo+rw Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:14 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info Nov 02 12:55:14 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:14 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.info" returned: 0 in 0.233s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.364s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Creating offline snapshot 2254e3e6-8d55-4384-8368-5b43b6a4f77a of volume c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:55:14 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8d9e86e1-3f15-4214-bd58-a525b8944fbc tempest-CreateVolumesFromSnapshotTest-786679875 None] Create snapshot completed successfully Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87630f-ef35-4333-bcba-8153c4e62658]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:14 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 Nov 02 12:55:14 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:14 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:14 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a 1G Nov 02 12:55:14 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:15 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a 1G" returned: 0 in 0.435s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:15 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a Nov 02 12:55:15 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:15 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a" returned: 0 in 0.312s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a is being set with open permissions: ugo+rw Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:15 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a Nov 02 12:55:15 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (4e7ced8d-68eb-4cb3-8326-f2852941ba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46ab8eb-a7d9-408e-8116-5746c493c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46ab8eb-a7d9-408e-8116-5746c493c944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1440320168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a16e92-0acc-4e37-a948-1095e26d94b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500acfc6-380f-476e-9820-cb9c30079875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500acfc6-380f-476e-9820-cb9c30079875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c5de2-c6f9-40c0-9644-5ecc7cee1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03c5de2-c6f9-40c0-9644-5ecc7cee1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a16e92-0acc-4e37-a948-1095e26d94b8', 'volume_name': 'volume-32a16e92-0acc-4e37-a948-1095e26d94b8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b52dfb5-29a6-4d53-a553-14573e05383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b52dfb5-29a6-4d53-a553-14573e05383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af01566-96bc-4d5c-ac97-c9c5687341cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:15 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume 32a16e92-0acc-4e37-a948-1095e26d94b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a16e92-0acc-4e37-a948-1095e26d94b8', 'volume_size': 1} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:15 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:15 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info Nov 02 12:55:15 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (ba696484-66ef-4179-8330-79c47e5e2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c04f9b-bf23-4548-a057-ff3e705098a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c04f9b-bf23-4548-a057-ff3e705098a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624654839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6c2a10-9c69-40f1-9acd-5407b9e5c406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6c2a10-9c69-40f1-9acd-5407b9e5c406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fe1a33-f281-42b0-9d70-23c30cb51027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12fe1a33-f281-42b0-9d70-23c30cb51027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8', 'volume_name': 'volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2ed7f-62af-493b-8e8e-907ec59e7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2ed7f-62af-493b-8e8e-907ec59e7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5e38a-9af2-400b-a4f4-21323f59d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8', 'volume_size': 1} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:16 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:16 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info is being set with open permissions: ugo+rw Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:16 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info Nov 02 12:55:16 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:16 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.info" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.102s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd69737b-6126-4af2-a51c-71239cbaaefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f369016c4f4ad7b642fe139f43c193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:11Z,use_quota=True,user_id='2308abf9a75e489ba10eee62abacc871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69779a7e-db5a-4daa-b374-73308f52fd06),volume_type_id=69779a7e-db5a-4daa-b374-73308f52fd06)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Creating volume dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:16 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:16 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1073741824 Nov 02 12:55:16 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (c7274d77-a6f5-4199-8753-8341efcbf457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a57294-571d-4043-867e-c8c072e69f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c72290c8-0e89-4d70-8070-540a080c5fe1 tempest-ProjectReaderTests-1423558856 None] Create snapshot completed successfully Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a57294-571d-4043-867e-c8c072e69f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761184799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3371e00f-d9df-4567-b7f8-cd6bc808e1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c12db36-179c-4bf8-bc3a-2047ffccb5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c12db36-179c-4bf8-bc3a-2047ffccb5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec62c59-1762-4481-85bf-84640b2bf350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec62c59-1762-4481-85bf-84640b2bf350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3371e00f-d9df-4567-b7f8-cd6bc808e1fa', 'volume_name': 'volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28f5cc-47c5-41b8-b199-e9693542dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28f5cc-47c5-41b8-b199-e9693542dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6240b3-7d0f-4be4-a019-5cae7b29ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume 3371e00f-d9df-4567-b7f8-cd6bc808e1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa', 'volume_size': 1} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (81ae4100-be82-42e6-b84b-821ad91a01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93fbc0a-d9ee-4b86-ad3d-9f9c5b69c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93fbc0a-d9ee-4b86-ad3d-9f9c5b69c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836022663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246e7d71-a06e-4522-9ce0-9b11f61feb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:17Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a4b4c-efa1-4fb8-8b1d-a92896a1cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895a4b4c-efa1-4fb8-8b1d-a92896a1cc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6265d7-74b6-4ec6-97cc-0111eeebe1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6265d7-74b6-4ec6-97cc-0111eeebe1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246e7d71-a06e-4522-9ce0-9b11f61feb0b', 'volume_name': 'volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da20a69-452e-4f1b-bb26-21b8e71c6cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da20a69-452e-4f1b-bb26-21b8e71c6cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4b59a2-7424-48e6-a7fd-ba6eb25326fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume 246e7d71-a06e-4522-9ce0-9b11f61feb0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b', 'volume_size': 1} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:17 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1073741824" returned: 0 in 0.551s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:17 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd Nov 02 12:55:17 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (9a5e1a47-693a-49ed-9d1a-7d471dc52e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b3f450-a361-4c2d-878e-bc9d178c501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b3f450-a361-4c2d-878e-bc9d178c501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914006539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d750c9c-5d89-48b9-a877-5c9d644555d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:17Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559da2d9-a75b-41e6-a8d4-f7bfd904a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559da2d9-a75b-41e6-a8d4-f7bfd904a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df7c65-a608-4bef-8e29-38ce27ca77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43df7c65-a608-4bef-8e29-38ce27ca77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d750c9c-5d89-48b9-a877-5c9d644555d1', 'volume_name': 'volume-2d750c9c-5d89-48b9-a877-5c9d644555d1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe80315f-0e76-491d-8117-7e3e543bcbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe80315f-0e76-491d-8117-7e3e543bcbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f1a815-06e0-40b4-8665-82c5aabb3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:17 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:17 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume 2d750c9c-5d89-48b9-a877-5c9d644555d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d750c9c-5d89-48b9-a877-5c9d644555d1', 'volume_size': 1} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.520s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70-b5180b2e-a149-4b77-820b-e1682fef41c6" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70-b5180b2e-a149-4b77-820b-e1682fef41c6" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Creating volume b5180b2e-a149-4b77-820b-e1682fef41c6 from snapshot 5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Attempting download of 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa ((None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}])) to volume dd69737b-6126-4af2-a51c-71239cbaaefd. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] snapshot: 5668d474-0d1a-4c46-b271-5c8b8c40ce70, volume: b5180b2e-a149-4b77-820b-e1682fef41c6, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-2254e3e6-8d55-4384-8368-5b43b6a4f77a-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b71a227-4513-4beb-91f2-7ee861bbc7c0]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[294cc5ad-887b-47b5-8f34-4ece1a30cef6]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-2254e3e6-8d55-4384-8368-5b43b6a4f77a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-2254e3e6-8d55-4384-8368-5b43b6a4f77a" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2254e3e6-8d55-4384-8368-5b43b6a4f77a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Deleting offline snapshot 2254e3e6-8d55-4384-8368-5b43b6a4f77a of volume c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] snapshot_file for this snap is: volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:55:17 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:17 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[87531c40-abdf-4c1c-823d-10828a41a1e6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:17 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9 Nov 02 12:55:17 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:17 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a Nov 02 12:55:17 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:17 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9" returned: 0 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:17 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.426s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79d37e0-20bb-4f06-82dd-8901fe355383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b6c421-fec1-455a-b31c-a632e6af9010]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9 Nov 02 12:55:18 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:18 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:18 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd883943-ec46-43cb-8c6b-dee697a94219]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 Nov 02 12:55:18 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9" returned: 1 in 0.365s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_g3stack9' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c4d676-f239-4499-8aab-c92e0250f350]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:18 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 Nov 02 12:55:18 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a Nov 02 12:55:18 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:18 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD Nov 02 12:55:18 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:18 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:19 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a Nov 02 12:55:19 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:19 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:19 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd Nov 02 12:55:19 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:19 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6.2254e3e6-8d55-4384-8368-5b43b6a4f77a" returned: 0 in 0.417s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2254e3e6-8d55-4384-8368-5b43b6a4f77a" released by "_delete_snapshot" :: held 1.849s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" released by "delete_snapshot" :: held 1.880s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Created reservations ['fcbabf74-7617-435f-99d5-7635087b4e22', 'cdf42ee5-6a05-4c97-9d2d-49c46dc84873', '291f513e-b348-4ac9-b352-1e1614fe310f', 'd0230fa4-cb13-4f64-b5a3-3d7a839fff01'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Delete snapshot completed successfully. Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a68ee263-ac48-4d82-bb88-58709be59c18 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-2254e3e6-8d55-4384-8368-5b43b6a4f77a-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-c7906772-ae6b-408a-ada7-7935e5b1f6b6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-c7906772-ae6b-408a-ada7-7935e5b1f6b6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc5a679-556a-4ae9-92fa-7148029836f5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:20 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd" returned: 0 in 1.102s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_76d93d6e-d2b7-4327-bdc2-ba006a9e1efa_6epjcd49devstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:55:20 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:20 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1G Nov 02 12:55:20 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:20 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 Nov 02 12:55:20 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:20 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd 1G" returned: 0 in 0.547s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Downloaded image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa ((None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}])) to volume dd69737b-6126-4af2-a51c-71239cbaaefd successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Temporary image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa for user 2308abf9a75e489ba10eee62abacc871 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Marking volume dd69737b-6126-4af2-a51c-71239cbaaefd as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Copying metadata from image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa to dd69737b-6126-4af2-a51c-71239cbaaefd. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Creating volume glance metadata for volume dd69737b-6126-4af2-a51c-71239cbaaefd backed by image 76d93d6e-d2b7-4327-bdc2-ba006a9e1efa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7badcd4b5cb48267810839f4fc7bb4de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:55:20 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6" returned: 0 in 0.692s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:20 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6 Nov 02 12:55:20 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd183f2-5d54-48a6-8625-4254f2a81c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd69737b-6126-4af2-a51c-71239cbaaefd', 'volume_size': 1, 'image_id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7badcd4b5cb48267810839f4fc7bb4de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f369016c4f4ad7b642fe139f43c193', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31d76896838d317d6a13afdc977cbac9c8efcd4f53127f1f3fef617a909ccdc2e58bfbc9ba56037eae50a65edc13371682da07fec977de8949fb37de15443d8a', 'id': '76d93d6e-d2b7-4327-bdc2-ba006a9e1efa', 'created_at': datetime.datetime(2026, 11, 2, 11, 55, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 55, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76d93d6e-d2b7-4327-bdc2-ba006a9e1efa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3141aacb-ca9d-414a-8897-d9dfd36d388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Volume volume-dd69737b-6126-4af2-a51c-71239cbaaefd (dd69737b-6126-4af2-a51c-71239cbaaefd): created successfully Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3141aacb-ca9d-414a-8897-d9dfd36d388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Flow 'volume_create_manager' (453baa79-a85e-4097-ad9d-bd766ed5357b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-4598d307-ea6f-4744-a5bb-673cad362b8b tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Created volume successfully. Nov 02 12:55:21 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-c7906772-ae6b-408a-ada7-7935e5b1f6b6" returned: 0 in 0.493s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-c7906772-ae6b-408a-ada7-7935e5b1f6b6" released by "delete_volume" :: held 1.351s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Acquiring lock "cinder-dd69737b-6126-4af2-a51c-71239cbaaefd-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "cinder-dd69737b-6126-4af2-a51c-71239cbaaefd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Acquiring lock "cinder-quobyte-dd69737b-6126-4af2-a51c-71239cbaaefd" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "cinder-quobyte-dd69737b-6126-4af2-a51c-71239cbaaefd" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Created reservations ['e5316631-2ee1-4aec-bc66-9b01243f40f6', '5d3a1993-b516-489b-9259-6c793316527b', '48667abc-0d92-4056-8244-e7bd7b52a6fe', '84c8a06d-20cc-498f-a0d3-16ec339e764c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea892113-96e4-41bf-9262-f3632c245466]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:21 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd Nov 02 12:55:21 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:21 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:21 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:22 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.485s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:22 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Deleted volume successfully. Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1339c7ed-944d-427d-98ca-61d42d402d55 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-c7906772-ae6b-408a-ada7-7935e5b1f6b6-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:22 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd" returned: 0 in 0.869s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:22 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd Nov 02 12:55:22 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:22 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dd69737b-6126-4af2-a51c-71239cbaaefd" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "cinder-quobyte-dd69737b-6126-4af2-a51c-71239cbaaefd" released by "delete_volume" :: held 1.432s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Created reservations ['73fdff8c-aaea-4bdc-a13b-0f6afc7cd001', '37c7fb39-5678-4488-b284-06994b68983d', '7edce988-75ae-4ab0-8b5f-8895a2ebd956', '5d505212-c72c-406c-842f-addf78723148'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (fc586959-864a-4fcd-9163-ebe75554f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412f0031-6472-4d36-b69f-a47afa77ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412f0031-6472-4d36-b69f-a47afa77ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654980308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e806b0c-51fb-4904-8dda-486ed85c3689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:23Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bff3a8-a0b7-4de0-9166-05ccb79e0926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:23 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:23 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bff3a8-a0b7-4de0-9166-05ccb79e0926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273aa0c4-93f5-429e-87d0-1678d819568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273aa0c4-93f5-429e-87d0-1678d819568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e806b0c-51fb-4904-8dda-486ed85c3689', 'volume_name': 'volume-4e806b0c-51fb-4904-8dda-486ed85c3689', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2ac168-b2de-4805-8f43-04d8b554d505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f2ac168-b2de-4805-8f43-04d8b554d505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222ddb3-aecf-4982-a329-765915a95620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:23 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Volume 4e806b0c-51fb-4904-8dda-486ed85c3689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e806b0c-51fb-4904-8dda-486ed85c3689', 'volume_size': 1} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:23 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.384s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Deleted volume successfully. Nov 02 12:55:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-13c7cecb-a22e-4395-90dc-5131f0ba5783 tempest-VolumeAndVolumeTypeFromImageTest-928821773 None] Lock "cinder-dd69737b-6126-4af2-a51c-71239cbaaefd-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:26 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6" returned: 0 in 7.977s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383, size 1024.00 MB, duration 7.98 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:55:26 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Converted 1024.00 MB image at 128.35 MB/s Nov 02 12:55:26 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 is being set with open permissions: ugo+rw Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:26 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 Nov 02 12:55:26 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:26 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" released by "_copy_volume_from_snapshot" :: held 9.187s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70-b5180b2e-a149-4b77-820b-e1682fef41c6" released by "_create_volume_from_snapshot" :: held 9.254s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.279s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.770s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1440320168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a16e92-0acc-4e37-a948-1095e26d94b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume 32a16e92-0acc-4e37-a948-1095e26d94b8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:26 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:26 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 1073741824 Nov 02 12:55:26 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723ad226-91e9-4a5b-b25d-f9330484d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5180b2e-a149-4b77-820b-e1682fef41c6', 'volume_size': 1, 'snapshot_id': '5668d474-0d1a-4c46-b271-5c8b8c40ce70'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b83b0f-23d4-47e4-844c-c33237f1e006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:26 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Volume volume-b5180b2e-a149-4b77-820b-e1682fef41c6 (b5180b2e-a149-4b77-820b-e1682fef41c6): created successfully Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b83b0f-23d4-47e4-844c-c33237f1e006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Flow 'volume_create_manager' (edbc5ffb-1cb8-4f3e-b599-1efe7f9cdf64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-867bbdd9-2e10-4d23-afb9-42948035cb91 tempest-VolumeDependencyTests-456924521 None] Created volume successfully. Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-5668d474-0d1a-4c46-b271-5c8b8c40ce70-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-5668d474-0d1a-4c46-b271-5c8b8c40ce70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Deleting offline snapshot 5668d474-0d1a-4c46-b271-5c8b8c40ce70 of volume a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] snapshot_file for this snap is: volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1128ef55-8b16-4dc0-bccb-3f3166fce493]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:27 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:27 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:27 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 1073741824" returned: 0 in 0.548s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:27 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 Nov 02 12:55:27 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:27 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79d37e0-20bb-4f06-82dd-8901fe355383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[717fd4f0-28cb-4fc8-afe4-ca0f325e0120]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:27 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.379s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624654839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:27 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 1073741824 Nov 02 12:55:27 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af01566-96bc-4d5c-ac97-c9c5687341cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a16e92-0acc-4e37-a948-1095e26d94b8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50a68b2-e500-48f5-925a-b55ad794c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-32a16e92-0acc-4e37-a948-1095e26d94b8 (32a16e92-0acc-4e37-a948-1095e26d94b8): created successfully Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50a68b2-e500-48f5-925a-b55ad794c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:27 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:27 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (4e7ced8d-68eb-4cb3-8326-f2852941ba9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3ae99fa-30e9-4542-a8f0-48724e95726e tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:28 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 1073741824" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:28 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.608s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:28 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:28 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:28 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 Nov 02 12:55:28 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:28 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.891s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1761184799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3371e00f-d9df-4567-b7f8-cd6bc808e1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:16Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume 3371e00f-d9df-4567-b7f8-cd6bc808e1fa {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:28 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:28 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa 1073741824 Nov 02 12:55:28 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee5e38a-9af2-400b-a4f4-21323f59d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36776c95-d12f-4b90-8660-357c6ccd7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:28 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 (dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8): created successfully Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36776c95-d12f-4b90-8660-357c6ccd7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (ba696484-66ef-4179-8330-79c47e5e2866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:28 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:28 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f14637f6-3871-4cd8-a8e9-6467aa33fa22 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.569s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:28 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70 Nov 02 12:55:28 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:29 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:29 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:29 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383.5668d474-0d1a-4c46-b271-5c8b8c40ce70" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-5668d474-0d1a-4c46-b271-5c8b8c40ce70" released by "_delete_snapshot" :: held 2.112s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" released by "delete_snapshot" :: held 2.141s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:29 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa 1073741824" returned: 0 in 0.603s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Created reservations ['fc6b08c5-e0e2-4f0b-8ff6-aa070ac582a3', '41d30a40-afe6-4332-a41c-39c88ed8114e', 'bb0742fe-85c3-49fe-b48b-20bec1aa21a3', 'f833a380-5d78-4295-ba9c-5e88537e524f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:29 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa Nov 02 12:55:29 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Delete snapshot completed successfully. Nov 02 12:55:29 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d3638079-bdba-48fd-acf8-bd7441da9611 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-5668d474-0d1a-4c46-b271-5c8b8c40ce70-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.381s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:55:29 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" returned: 0 in 0.280s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.471s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1836022663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246e7d71-a06e-4522-9ce0-9b11f61feb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:17Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume 246e7d71-a06e-4522-9ce0-9b11f61feb0b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:29 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6240b3-7d0f-4be4-a019-5cae7b29ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b 1073741824 Nov 02 12:55:29 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fc52ca-5046-4a3b-8f1c-54064003b099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa (3371e00f-d9df-4567-b7f8-cd6bc808e1fa): created successfully Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fc52ca-5046-4a3b-8f1c-54064003b099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (c7274d77-a6f5-4199-8753-8341efcbf457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:29 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c9a1fa1d-3158-4d75-a181-e1581b52ff29 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (661c8a53-b3d7-4afe-92b3-aede9a7496d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cbc9f5-84ab-4df6-865b-de5be56cde47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cbc9f5-84ab-4df6-865b-de5be56cde47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1619584875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93ef122-8512-4083-acea-962b0fabade7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:30Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc576dc3-58da-481d-9f56-91fbaad70ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc576dc3-58da-481d-9f56-91fbaad70ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a18315-6c95-4028-afbb-a40e1a988732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a18315-6c95-4028-afbb-a40e1a988732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93ef122-8512-4083-acea-962b0fabade7', 'volume_name': 'volume-b93ef122-8512-4083-acea-962b0fabade7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d0bd47-64f8-4fe9-8235-011b36a69a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d0bd47-64f8-4fe9-8235-011b36a69a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fe7ac1-ec75-4695-a863-38488cd6f051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Volume b93ef122-8512-4083-acea-962b0fabade7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93ef122-8512-4083-acea-962b0fabade7', 'volume_size': 1} Nov 02 12:55:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:30 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b 1073741824" returned: 0 in 0.630s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-a79d37e0-20bb-4f06-82dd-8901fe355383-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-a79d37e0-20bb-4f06-82dd-8901fe355383-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:30 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b Nov 02 12:55:30 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (a30df03a-233b-4682-b826-d8c3da7d86c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6593b1d1-bbcc-4b7a-b905-89d5a3d8354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6593b1d1-bbcc-4b7a-b905-89d5a3d8354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308118354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755b55b3-89d6-4153-a9f7-fefe52f93d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:30Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd77d35-0a7f-4f45-ba43-ae3e6ccbf357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd77d35-0a7f-4f45-ba43-ae3e6ccbf357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4d0f02-5b49-41b7-89f4-cf0ea744f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4d0f02-5b49-41b7-89f4-cf0ea744f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755b55b3-89d6-4153-a9f7-fefe52f93d82', 'volume_name': 'volume-755b55b3-89d6-4153-a9f7-fefe52f93d82', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137acf48-628e-425b-a826-39d9f5e1b6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137acf48-628e-425b-a826-39d9f5e1b6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82553f4-f674-45a8-8719-480eb8b527d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Volume 755b55b3-89d6-4153-a9f7-fefe52f93d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755b55b3-89d6-4153-a9f7-fefe52f93d82', 'volume_size': 1} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" acquired by "delete_volume" :: waited 0.073s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822a0a8-18a7-4b01-93fe-a085f804fab6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:30 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.157s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914006539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d750c9c-5d89-48b9-a877-5c9d644555d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04f5fa980c4d4fbaa8f4bd65f94e30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:17Z,use_quota=True,user_id='a565a7843b484582a53ad94ae5b8090b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Creating volume 2d750c9c-5d89-48b9-a877-5c9d644555d1 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:30 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:30 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 1073741824 Nov 02 12:55:30 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4b59a2-7424-48e6-a7fd-ba6eb25326fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067fd9cd-7437-4223-934b-554c19e20503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b (246e7d71-a06e-4522-9ce0-9b11f61feb0b): created successfully Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067fd9cd-7437-4223-934b-554c19e20503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (81ae4100-be82-42e6-b84b-821ad91a01b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:30 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:30 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ad436e6a-5af9-4e8c-8fe1-fe77ddfc0776 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (c5d06f31-58ef-4299-b410-7f9d256cb43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737d7e13-fce6-408d-a22d-6fad53d91e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737d7e13-fce6-408d-a22d-6fad53d91e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907170917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c7dba-6ef9-45ed-9086-720f6f403fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ac5814-f148-4e19-8707-d318df4ce61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ac5814-f148-4e19-8707-d318df4ce61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502440d9-67ec-4245-b4be-0a4cca309986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502440d9-67ec-4245-b4be-0a4cca309986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7c7dba-6ef9-45ed-9086-720f6f403fae', 'volume_name': 'volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4bdf6-466c-4e92-9923-871c60f1dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4bdf6-466c-4e92-9923-871c60f1dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4b2ed0-1354-4df6-9e0c-5f5945d29aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Volume 9f7c7dba-6ef9-45ed-9086-720f6f403fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae', 'volume_size': 1} Nov 02 12:55:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:31 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.554s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:31 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383 Nov 02 12:55:31 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:31 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (2a4dadff-69fb-4766-aa14-fb9accdc116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3eb4da-4c7c-4808-b512-449fd4a183c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 1073741824" returned: 0 in 0.650s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3eb4da-4c7c-4808-b512-449fd4a183c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179961976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5e4c92-fbca-497a-bce0-108af3c7d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cb5d29-695a-4f04-b8a7-d51665e6f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cb5d29-695a-4f04-b8a7-d51665e6f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964f4742-0897-4049-8324-f8163d6f1446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964f4742-0897-4049-8324-f8163d6f1446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5e4c92-fbca-497a-bce0-108af3c7d866', 'volume_name': 'volume-6d5e4c92-fbca-497a-bce0-108af3c7d866', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94978c96-e0d1-4e98-8d0b-3232c46ae120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94978c96-e0d1-4e98-8d0b-3232c46ae120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c3ad58-8fbd-41a1-97d9-45d1fc2accf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Volume 6d5e4c92-fbca-497a-bce0-108af3c7d866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5e4c92-fbca-497a-bce0-108af3c7d866', 'volume_size': 1} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:31 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 Nov 02 12:55:31 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:31 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a79d37e0-20bb-4f06-82dd-8901fe355383" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-a79d37e0-20bb-4f06-82dd-8901fe355383" released by "delete_volume" :: held 0.999s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Created reservations ['5460bd01-f147-4edc-bc4e-19211ce4cfc5', 'ab78eb80-ada2-44f3-a87e-6fec1c54030d', 'ba6119c1-8576-4581-b523-5dc8ba407ac3', 'd949b7ea-3afe-4c20-a669-e2341485eca1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:31 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:31 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (0258c64c-c848-4cf7-a406-6c7200a03668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db96e98-6866-4dbd-b139-fef1c75934a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db96e98-6866-4dbd-b139-fef1c75934a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438583660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc0217-576f-43e0-b372-638281e12d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff6f39c-e3a7-4590-b5a0-a7077c7cf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff6f39c-e3a7-4590-b5a0-a7077c7cf845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa0ba6-06d2-4eb4-a9a7-319f29d77acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa0ba6-06d2-4eb4-a9a7-319f29d77acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fc0217-576f-43e0-b372-638281e12d31', 'volume_name': 'volume-09fc0217-576f-43e0-b372-638281e12d31', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f1a6b9-48ec-445b-b550-8063662e2cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f1a6b9-48ec-445b-b550-8063662e2cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb0994b-3751-4409-a7e8-d00e59fdb556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Volume 09fc0217-576f-43e0-b372-638281e12d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fc0217-576f-43e0-b372-638281e12d31', 'volume_size': 1} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.231s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654980308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e806b0c-51fb-4904-8dda-486ed85c3689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:23Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Creating volume 4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f1a815-06e0-40b4-8665-82c5aabb3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d750c9c-5d89-48b9-a877-5c9d644555d1', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 1073741824 Nov 02 12:55:31 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a65ab-de01-4275-9173-22c9978214b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Volume volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 (2d750c9c-5d89-48b9-a877-5c9d644555d1): created successfully Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a65ab-de01-4275-9173-22c9978214b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Flow 'volume_create_manager' (9a5e1a47-693a-49ed-9d1a-7d471dc52e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a9071b2f-3bfa-4c29-a47c-3952c33c2b42 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created volume successfully. Nov 02 12:55:31 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.291s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Deleted volume successfully. Nov 02 12:55:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3fad62df-1e3e-40a8-a9ba-e3246b2a4bd0 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-a79d37e0-20bb-4f06-82dd-8901fe355383-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-2d750c9c-5d89-48b9-a877-5c9d644555d1-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-2d750c9c-5d89-48b9-a877-5c9d644555d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:32 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 1073741824" returned: 0 in 0.464s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-2d750c9c-5d89-48b9-a877-5c9d644555d1" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-2d750c9c-5d89-48b9-a877-5c9d644555d1" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:32 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 Nov 02 12:55:32 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d884ce1-a733-487d-8456-1dbc56f18537]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:32 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 Nov 02 12:55:32 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:32 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-b5180b2e-a149-4b77-820b-e1682fef41c6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689" returned: 0 in 0.281s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.459s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1619584875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93ef122-8512-4083-acea-962b0fabade7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:30Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Creating volume b93ef122-8512-4083-acea-962b0fabade7 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:32 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222ddb3-aecf-4982-a329-765915a95620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e806b0c-51fb-4904-8dda-486ed85c3689', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7f37ea-248c-4c48-8f0d-2e06a2cf29c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:32 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 1073741824 Nov 02 12:55:32 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-b5180b2e-a149-4b77-820b-e1682fef41c6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:32 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Volume volume-4e806b0c-51fb-4904-8dda-486ed85c3689 (4e806b0c-51fb-4904-8dda-486ed85c3689): created successfully Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7f37ea-248c-4c48-8f0d-2e06a2cf29c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (fc586959-864a-4fcd-9163-ebe75554f50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:32 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-025e15c7-e64d-4e1a-af54-44e4c6c046c3 tempest-ProjectReaderTests-1423558856 None] Created volume successfully. Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e14e9-6b47-4f76-8c0e-8af1c492214b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:32 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:32 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1 Nov 02 12:55:32 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:32 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 Nov 02 12:55:32 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:32 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2d750c9c-5d89-48b9-a877-5c9d644555d1" returned: 0 in 0.291s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-2d750c9c-5d89-48b9-a877-5c9d644555d1" released by "delete_volume" :: held 0.785s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['6dbee859-1592-4f6c-b2b0-ef8b0efef2f1', '8b3acd31-89a1-47ca-9b06-9e89115b9d5a', 'ac6118d2-21c6-43d3-b0e7-7d538b184856', '340054a3-b0b1-4bf4-88c6-afa55ada2c5f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 1073741824" returned: 0 in 0.585s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:33 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:33 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6 Nov 02 12:55:33 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:33 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 Nov 02 12:55:33 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-246e7d71-a06e-4522-9ce0-9b11f61feb0b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:33 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-246e7d71-a06e-4522-9ce0-9b11f61feb0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-246e7d71-a06e-4522-9ce0-9b11f61feb0b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-246e7d71-a06e-4522-9ce0-9b11f61feb0b" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:33 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a611f-d44a-4f11-aee1-52ed96e3001f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b5180b2e-a149-4b77-820b-e1682fef41c6" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-quobyte-b5180b2e-a149-4b77-820b-e1682fef41c6" released by "delete_volume" :: held 0.941s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:33 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7" returned: 0 in 0.483s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308118354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755b55b3-89d6-4153-a9f7-fefe52f93d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:30Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Creating volume 755b55b3-89d6-4153-a9f7-fefe52f93d82 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:33 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:33 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:33 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b Nov 02 12:55:33 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:33 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 1073741824 Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fe7ac1-ec75-4695-a863-38488cd6f051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93ef122-8512-4083-acea-962b0fabade7', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:33 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789844-bb24-46f8-9be3-c652f2e0e5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Created reservations ['694488c8-6759-4460-9794-49cac5cba4a4', '8e47415f-0f44-49e3-a9cf-e277bb072e42', '17f1cd7d-b5fa-4924-a0da-2e03865ce061', 'dbb37950-0ccf-4862-94d3-730e8ad7c92a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:33 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Volume volume-b93ef122-8512-4083-acea-962b0fabade7 (b93ef122-8512-4083-acea-962b0fabade7): created successfully Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789844-bb24-46f8-9be3-c652f2e0e5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (661c8a53-b3d7-4afe-92b3-aede9a7496d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-35412009-bc33-4fed-b7a3-5766f67dfa61 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-2d750c9c-5d89-48b9-a877-5c9d644555d1-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b90adf79-5e21-434e-a80c-ea863b56b7db tempest-CreateVolumesFromImageTest-1119987093 None] Created volume successfully. Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:33 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:33 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:34 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:34 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b Nov 02 12:55:34 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:34 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Deleted volume successfully. Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c62f48b7-3202-4e22-8e29-a48891e37a63 tempest-VolumeDependencyTests-456924521 None] Lock "cinder-b5180b2e-a149-4b77-820b-e1682fef41c6-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:34 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 1073741824" returned: 0 in 0.582s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-246e7d71-a06e-4522-9ce0-9b11f61feb0b" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 Nov 02 12:55:34 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-246e7d71-a06e-4522-9ce0-9b11f61feb0b" released by "delete_volume" :: held 0.903s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['1dd5cf34-4822-4419-b853-89571ab5a9fb', '4925e9f7-4c43-40a5-a4dd-dea3f608b91c', '1cce915f-0162-485f-a61d-9147944b8b51', '1fe89c97-5b86-4aac-8f96-ec06befad6e0'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:34 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:34 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:34 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.740s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-907170917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c7dba-6ef9-45ed-9086-720f6f403fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Creating volume 9f7c7dba-6ef9-45ed-9086-720f6f403fae {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:34 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-3371e00f-d9df-4567-b7f8-cd6bc808e1fa-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:34 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae 1073741824 Nov 02 12:55:34 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82553f4-f674-45a8-8719-480eb8b527d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755b55b3-89d6-4153-a9f7-fefe52f93d82', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b3b1e6-9263-4fe9-87f6-72c86c79ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-3371e00f-d9df-4567-b7f8-cd6bc808e1fa-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Volume volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 (755b55b3-89d6-4153-a9f7-fefe52f93d82): created successfully Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b3b1e6-9263-4fe9-87f6-72c86c79ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (a30df03a-233b-4682-b826-d8c3da7d86c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-08dd82a4-d69c-4091-b989-6eb927112b2d tempest-CreateVolumesFromImageTest-1119987093 None] Created volume successfully. Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b17156-221a-4d9a-9578-9b2e7ab0c04e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:34 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-cc6d378f-7df0-4def-b9f0-e74b90228765 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-246e7d71-a06e-4522-9ce0-9b11f61feb0b-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:35 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa Nov 02 12:55:35 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:35 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae 1073741824" returned: 0 in 0.576s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:35 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae Nov 02 12:55:35 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:35 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" returned: 0 in 0.478s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:35 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa Nov 02 12:55:35 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:35 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179961976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5e4c92-fbca-497a-bce0-108af3c7d866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Creating volume 6d5e4c92-fbca-497a-bce0-108af3c7d866 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:35 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:35 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 1073741824 Nov 02 12:55:35 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c4b2ed0-1354-4df6-9e0c-5f5945d29aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d327f26-d69f-414f-869b-8c3ba5c61dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:35 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Volume volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae (9f7c7dba-6ef9-45ed-9086-720f6f403fae): created successfully Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d327f26-d69f-414f-869b-8c3ba5c61dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (c5d06f31-58ef-4299-b410-7f9d256cb43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:35 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:35 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a3e76708-6eb5-497b-b9aa-58af281812d4 tempest-CreateVolumesFromImageTest-1119987093 None] Created volume successfully. Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-3371e00f-d9df-4567-b7f8-cd6bc808e1fa" released by "delete_volume" :: held 0.845s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['c24e5cf6-05ae-44d1-86f9-de845c3154d0', '4545239e-bb6d-450f-88e6-556e50603769', 'eaaf997f-278c-47cd-b11d-232616c53429', '3bcbe1ae-ac85-43b4-b54a-fae0c06f6221'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:35 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:35 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:36 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 1073741824" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:36 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 Nov 02 12:55:36 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:36 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.329s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-525964e9-08c7-441d-840b-3989e1763cda tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-3371e00f-d9df-4567-b7f8-cd6bc808e1fa-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:36 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.782s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438583660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fc0217-576f-43e0-b372-638281e12d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8686efdac749478007ebb77cc589d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:31Z,use_quota=True,user_id='75c37ac532a447d8bc3436e730512fae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Creating volume 09fc0217-576f-43e0-b372-638281e12d31 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:36 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c3ad58-8fbd-41a1-97d9-45d1fc2accf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5e4c92-fbca-497a-bce0-108af3c7d866', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:36 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 1073741824 Nov 02 12:55:36 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737a5628-ae38-4e4b-8a8a-c0e10affee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:36 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Volume volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 (6d5e4c92-fbca-497a-bce0-108af3c7d866): created successfully Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737a5628-ae38-4e4b-8a8a-c0e10affee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (2a4dadff-69fb-4766-aa14-fb9accdc116b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a0e091ac-42cf-47df-8f76-9a4cc2b8879f tempest-CreateVolumesFromImageTest-1119987093 None] Created volume successfully. Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:36 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 1073741824" returned: 0 in 0.506s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:37 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 Nov 02 12:55:37 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8bb20-f1a6-4d5f-854b-7a0b0b9970fe]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 Nov 02 12:55:37 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:37 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.087s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb0994b-3751-4409-a7e8-d00e59fdb556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fc0217-576f-43e0-b372-638281e12d31', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2220457-de80-45a8-abb9-861492b843af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Creating offline snapshot 04b159d2-6963-429a-bd8b-c9d6803ce308 of volume 4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:55:37 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Volume volume-09fc0217-576f-43e0-b372-638281e12d31 (09fc0217-576f-43e0-b372-638281e12d31): created successfully Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2220457-de80-45a8-abb9-861492b843af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Flow 'volume_create_manager' (0258c64c-c848-4cf7-a406-6c7200a03668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c911ba0d-d374-4426-8b27-ed8f218d783b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ed217919-3459-467a-ae96-7a9f7acb7fed tempest-CreateVolumesFromImageTest-1119987093 None] Created volume successfully. Nov 02 12:55:37 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 Nov 02 12:55:37 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:37 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" returned: 0 in 0.440s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8 Nov 02 12:55:37 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:37 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:37 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 1G Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8" released by "delete_volume" :: held 0.790s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:37 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['8964656d-105d-47c8-83f1-bfc2714e3cea', 'aca81dc5-b3e9-4bf8-abcd-b102c1eb5540', '6bba37fa-7f10-403f-872f-411ba1772478', 'a264881a-9322-4dca-9180-b51b28566869'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:37 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:37 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-32a16e92-0acc-4e37-a948-1095e26d94b8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-32a16e92-0acc-4e37-a948-1095e26d94b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-32a16e92-0acc-4e37-a948-1095e26d94b8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-32a16e92-0acc-4e37-a948-1095e26d94b8" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:38 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.333s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7befada5-2748-4392-8f72-663fc59a5f7e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-412d17a8-e37d-4b39-ad54-19f190a7728d tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-dfa9e884-4a3f-4a85-ac09-043a0a9f1ac8-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:38 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 1G" returned: 0 in 0.568s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e806b0c-51fb-4904-8dda-486ed85c3689 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:38 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e806b0c-51fb-4904-8dda-486ed85c3689 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 Nov 02 12:55:38 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:38 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 Nov 02 12:55:38 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-09fc0217-576f-43e0-b372-638281e12d31-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-09fc0217-576f-43e0-b372-638281e12d31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-quobyte-09fc0217-576f-43e0-b372-638281e12d31" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-09fc0217-576f-43e0-b372-638281e12d31" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb055f8-42dd-4a1d-b178-a1385d2b5798]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:38 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 Nov 02 12:55:38 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:38 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e806b0c-51fb-4904-8dda-486ed85c3689 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308" returned: 0 in 0.479s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:38 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:38 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 is being set with open permissions: ugo+rw Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8" returned: 0 in 0.544s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:38 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 Nov 02 12:55:38 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:38 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8 Nov 02 12:55:38 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31 Nov 02 12:55:39 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308" returned: 0 in 0.287s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-32a16e92-0acc-4e37-a948-1095e26d94b8" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-32a16e92-0acc-4e37-a948-1095e26d94b8" released by "delete_volume" :: held 0.965s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['39feb1e1-9a57-4d44-9d51-7c7dd0e5e8b9', '110cfff7-9e9f-4b47-b8ed-638bb9c202d3', '10125e37-1866-400b-a7ca-b3fc10969fe1', '1a08967b-068c-43ac-ad20-19727e83521a'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:39 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-09fc0217-576f-43e0-b372-638281e12d31" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-09fc0217-576f-43e0-b372-638281e12d31" released by "delete_volume" :: held 0.911s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:39 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info is being set with open permissions: ugo+rw Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info Nov 02 12:55:39 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Created reservations ['b88e3d1f-5f16-4cf9-bf35-fe1e12f03003', '768963cd-15d3-46aa-9b3f-81b0b9dcb93a', '670b5262-dde7-45dc-a8a4-f61a84b08532', '52200dff-4367-4b24-a5d1-069c0e44ec21'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-6d5e4c92-fbca-497a-bce0-108af3c7d866-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:39 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:39 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-6d5e4c92-fbca-497a-bce0-108af3c7d866-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:39 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.406s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-quobyte-6d5e4c92-fbca-497a-bce0-108af3c7d866" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-6d5e4c92-fbca-497a-bce0-108af3c7d866" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6f85e15d-068a-4077-8aa5-b14d73e7a3f0 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-32a16e92-0acc-4e37-a948-1095e26d94b8-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb8aa0-afb5-4d3d-93fb-c21070d2d5d7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:39 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.info" returned: 0 in 0.443s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-385dbd3f-ed62-45b7-bc37-ed17e0a4d393 tempest-ProjectReaderTests-1423558856 None] Create snapshot completed successfully Nov 02 12:55:39 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:39 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:39 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Deleted volume successfully. Nov 02 12:55:40 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 Nov 02 12:55:40 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b2b46ab5-0bcd-451b-8886-12df0cb7c599 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-09fc0217-576f-43e0-b372-638281e12d31-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:40 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866" returned: 0 in 0.418s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:40 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866 Nov 02 12:55:40 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-9dae360f-52be-43ce-9e73-69e1350a2056-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-9dae360f-52be-43ce-9e73-69e1350a2056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-9dae360f-52be-43ce-9e73-69e1350a2056" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-04b159d2-6963-429a-bd8b-c9d6803ce308-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-9dae360f-52be-43ce-9e73-69e1350a2056" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleting offline snapshot 9dae360f-52be-43ce-9e73-69e1350a2056 of volume 67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] snapshot_file for this snap is: volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-04b159d2-6963-429a-bd8b-c9d6803ce308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f46667-2bde-4c25-8cee-49b1868a383a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:40 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-04b159d2-6963-429a-bd8b-c9d6803ce308" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6d5e4c92-fbca-497a-bce0-108af3c7d866" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-6d5e4c92-fbca-497a-bce0-108af3c7d866" released by "delete_volume" :: held 0.835s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-04b159d2-6963-429a-bd8b-c9d6803ce308" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Deleting offline snapshot 04b159d2-6963-429a-bd8b-c9d6803ce308 of volume 4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] snapshot_file for this snap is: volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e9282a-0d9b-4c34-958f-b2438284ebd2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:40 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 Nov 02 12:55:40 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Created reservations ['ca087c42-ccc1-45af-9867-56ae852b8dff', '7f91eecd-41b4-42c8-a55c-0fe0529d30a5', '7f15838c-976a-48e8-8d25-6610d8617e18', '70f15cc3-fb3c-4f45-b1f5-ec4de77cb130'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:40 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 Nov 02 12:55:40 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:40 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:40 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-9f7c7dba-6ef9-45ed-9086-720f6f403fae-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-9f7c7dba-6ef9-45ed-9086-720f6f403fae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-quobyte-9f7c7dba-6ef9-45ed-9086-720f6f403fae" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-9f7c7dba-6ef9-45ed-9086-720f6f403fae" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e27a0-d263-4b74-a7dd-b448a0b32afb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ebffc6-876a-4d07-8a69-2988365d3daf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:41 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e806b0c-51fb-4904-8dda-486ed85c3689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:41 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae Nov 02 12:55:41 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68ffcb-45ec-4b74-8ccf-3ecd481a6520]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004b82f-74e3-4eca-aa3e-197d1bc33142]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:41 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Deleted volume successfully. Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-e5b667d4-d3a1-4edd-8b98-ab14f21abe80 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-6d5e4c92-fbca-497a-bce0-108af3c7d866-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:41 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf Nov 02 12:55:41 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 Nov 02 12:55:41 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae" returned: 0 in 0.508s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae Nov 02 12:55:41 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf" returned: 0 in 0.473s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 Nov 02 12:55:41 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689" returned: 0 in 0.578s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:41 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9f7c7dba-6ef9-45ed-9086-720f6f403fae" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:41 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 Nov 02 12:55:41 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-9f7c7dba-6ef9-45ed-9086-720f6f403fae" released by "delete_volume" :: held 0.866s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:41 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Created reservations ['a91d2f46-5b5c-4e5b-ba3f-db53314cfbcf', 'ad842829-fb27-4af2-a640-fb50cfafeba5', 'f3dad3cc-06fc-4cad-92c0-0eb9898d60aa', 'e8d5f16e-a8cc-44e3-8346-76c2a007fdc4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:42 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:42 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-755b55b3-89d6-4153-a9f7-fefe52f93d82-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-755b55b3-89d6-4153-a9f7-fefe52f93d82-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-quobyte-755b55b3-89d6-4153-a9f7-fefe52f93d82" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:42 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-755b55b3-89d6-4153-a9f7-fefe52f93d82" acquired by "delete_volume" :: waited 0.041s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:42 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056 Nov 02 12:55:42 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[24500d50-499a-4dfe-94b8-29efe7e44b64]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:42 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308" returned: 0 in 0.581s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:42 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308 Nov 02 12:55:42 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:42 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:42 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 Nov 02 12:55:42 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Deleted volume successfully. Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ac7f0340-0141-460c-80c9-abdc2d2615d2 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-9f7c7dba-6ef9-45ed-9086-720f6f403fae-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf.9dae360f-52be-43ce-9e73-69e1350a2056" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-9dae360f-52be-43ce-9e73-69e1350a2056" released by "_delete_snapshot" :: held 2.204s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" released by "delete_snapshot" :: held 2.245s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['85636bd1-4bcb-42d9-b829-813b3ba1a50c', '49a064d7-9f3f-46ef-ac05-6bbb529a3397', '0ff094ea-747e-46b4-b00c-1465e9964b8a', 'aca0641c-23e0-465d-b36e-68785fb25780'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:42 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689.04b159d2-6963-429a-bd8b-c9d6803ce308" returned: 0 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-04b159d2-6963-429a-bd8b-c9d6803ce308" released by "_delete_snapshot" :: held 2.208s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" released by "delete_snapshot" :: held 2.263s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82" returned: 0 in 0.555s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:42 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82 Nov 02 12:55:42 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Delete snapshot completed successfully. Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-21315c80-6fbe-44cb-a214-a4e6eb7c5662 tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-9dae360f-52be-43ce-9e73-69e1350a2056-delete_snapshot" released by "delete_snapshot" :: held 2.510s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:42 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Created reservations ['9a558e2e-d2b2-4f05-84c0-d5761953cfd0', '19ac39ae-e382-4a9c-9d10-86fd427284bf', 'ffa506e5-c59a-4dd0-a053-d1e970c6ff56', '6c8082e6-02eb-43b8-a1b2-5d9ecd20438e'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Delete snapshot completed successfully. Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6fe0e337-b98a-48e1-873a-97dea406c8da tempest-ProjectReaderTests-1423558856 None] Lock "cinder-04b159d2-6963-429a-bd8b-c9d6803ce308-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:43 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-755b55b3-89d6-4153-a9f7-fefe52f93d82" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-755b55b3-89d6-4153-a9f7-fefe52f93d82" released by "delete_volume" :: held 0.915s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Created reservations ['ef2c3aa7-1440-434a-a2bf-734698b0514e', 'db0cdb7c-36d8-4c36-8a95-6f5b6edf59f1', '34b98f96-95ae-4529-94c5-2020276d9093', 'da23ee06-7c04-4884-99b6-2a2ac9d84819'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:43 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:43 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:43 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Deleted volume successfully. Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7a70bd44-0cca-48e3-8a69-ad6083c3e911 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-755b55b3-89d6-4153-a9f7-fefe52f93d82-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-67ebffc6-876a-4d07-8a69-2988365d3daf-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-67ebffc6-876a-4d07-8a69-2988365d3daf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-4e806b0c-51fb-4904-8dda-486ed85c3689-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-4e806b0c-51fb-4904-8dda-486ed85c3689-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef82c5-56fc-4c0e-85aa-4c07e7743a8d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:43 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dfd24d-2db6-47cf-a822-510f12175a79]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:44 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf Nov 02 12:55:44 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 Nov 02 12:55:44 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf" returned: 0 in 0.431s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:44 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf Nov 02 12:55:44 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-b93ef122-8512-4083-acea-962b0fabade7-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:44 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689" returned: 0 in 0.453s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-b93ef122-8512-4083-acea-962b0fabade7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:44 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689 Nov 02 12:55:44 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "cinder-quobyte-b93ef122-8512-4083-acea-962b0fabade7" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-b93ef122-8512-4083-acea-962b0fabade7" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[45789192-d4cc-4989-adab-f32d45c1f9a3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:44 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-67ebffc6-876a-4d07-8a69-2988365d3daf" returned: 0 in 0.347s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:44 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 Nov 02 12:55:44 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-quobyte-67ebffc6-876a-4d07-8a69-2988365d3daf" released by "delete_volume" :: held 0.864s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Created reservations ['404dcf05-acdf-4a4a-b12b-319325a07556', 'a80294c4-b00e-4e44-974e-cac8c8684046', '058dace6-2425-48f9-a345-8ce5cf381812', '85d97a42-9fa4-4891-b3d4-c50cb9ab39c9'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:44 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e806b0c-51fb-4904-8dda-486ed85c3689" returned: 0 in 0.378s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4e806b0c-51fb-4904-8dda-486ed85c3689" released by "delete_volume" :: held 0.936s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:44 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:44 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:44 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Created reservations ['0630dd23-4b25-4d59-bcbe-4611fc5da1ca', 'e73ef29f-5ed6-4ba5-a302-d31bbe733e6c', '6e42a8d6-1618-48aa-9511-e8f004a4d222', 'd29e7e14-9ba6-4baf-a52d-72ecc5aacacf'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:45 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:45 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:45 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:45 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7 Nov 02 12:55:45 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:45 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.498s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Deleted volume successfully. Nov 02 12:55:45 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Deleted volume successfully. Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0eeabc6f-4638-46b2-8564-ad085958682a tempest-CreateVolumesFromSnapshotTest-786679875 None] Lock "cinder-67ebffc6-876a-4d07-8a69-2988365d3daf-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45ea502d-a4d8-4869-959a-819ddb153873 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-4e806b0c-51fb-4904-8dda-486ed85c3689-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:45 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b93ef122-8512-4083-acea-962b0fabade7" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-quobyte-b93ef122-8512-4083-acea-962b0fabade7" released by "delete_volume" :: held 0.939s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Created reservations ['7b3d758e-150d-4c19-8a02-278b050e5521', '71fb2aa4-7782-400b-8d3c-792ead75a072', 'eb4b5427-cffc-4c86-bcd6-d3dbf938a85e', '91a6d9f2-bdf2-49d8-b095-ca51d2098947'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:45 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:45 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:45 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.262s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Deleted volume successfully. Nov 02 12:55:45 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b62e47de-3274-4a0c-8a20-2e276f07b481 tempest-CreateVolumesFromImageTest-1119987093 None] Lock "cinder-b93ef122-8512-4083-acea-962b0fabade7-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (8f9b43b1-e9ed-4bc8-94aa-2baae536d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cff1b02-4f31-43e1-ae55-adda30dbffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cff1b02-4f31-43e1-ae55-adda30dbffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260238430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4361816a-798b-49f7-b786-df90f168df43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:47Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e7ae86-7a5f-48a5-acb0-78d65b7f3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e7ae86-7a5f-48a5-acb0-78d65b7f3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739e1c5f-bd06-41fb-820e-1bb02f114d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739e1c5f-bd06-41fb-820e-1bb02f114d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4361816a-798b-49f7-b786-df90f168df43', 'volume_name': 'volume-4361816a-798b-49f7-b786-df90f168df43', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e44978d-7d16-4c5b-bb97-3ce0d9c89735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e44978d-7d16-4c5b-bb97-3ce0d9c89735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ab745a-52e9-4409-8fb6-c9841008ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:46 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Volume 4361816a-798b-49f7-b786-df90f168df43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4361816a-798b-49f7-b786-df90f168df43', 'volume_size': 1} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260238430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4361816a-798b-49f7-b786-df90f168df43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:47Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Creating volume 4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:46 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:46 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 1073741824 Nov 02 12:55:46 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:47 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 1073741824" returned: 0 in 0.612s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:47 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 Nov 02 12:55:47 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:47 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ab745a-52e9-4409-8fb6-c9841008ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4361816a-798b-49f7-b786-df90f168df43', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bcb62c-dae1-4a8d-8661-e6195dd6e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Volume volume-4361816a-798b-49f7-b786-df90f168df43 (4361816a-798b-49f7-b786-df90f168df43): created successfully Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bcb62c-dae1-4a8d-8661-e6195dd6e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (8f9b43b1-e9ed-4bc8-94aa-2baae536d243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5c5218a0-6213-4001-b547-214dd9c1f803 tempest-ProjectReaderTests-1423558856 None] Created volume successfully. Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Creating offline snapshot d93a86d7-a174-4df4-a4bc-c4cb8ef06785 of volume 4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae81aa5-6730-4c97-a504-afaa64da0fad]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:49 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 Nov 02 12:55:49 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:49 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:49 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 1G Nov 02 12:55:49 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:50 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 1G" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4361816a-798b-49f7-b786-df90f168df43 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:50 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4361816a-798b-49f7-b786-df90f168df43 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 Nov 02 12:55:50 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Flow 'volume_create_manager' (3fbd375d-2219-44fc-9260-7303da6d8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e4323-b3ae-4d95-b7b1-dc746200ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0e4323-b3ae-4d95-b7b1-dc746200ae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2cba30-6336-4794-9bf4-caf2c70bbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c311b0bb1949f2b2e05ee2606ff6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:50Z,use_quota=True,user_id='a2a9414588d944c0a878036ea6fdb571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843aa4f8-e550-4730-9399-b53463c95260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843aa4f8-e550-4730-9399-b53463c95260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dff7126-1e89-4e4d-9969-e7560e1d2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dff7126-1e89-4e4d-9969-e7560e1d2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2cba30-6336-4794-9bf4-caf2c70bbf76', 'volume_name': 'volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6f65f6-d2dc-44b2-8dee-5bc62d3f6175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6f65f6-d2dc-44b2-8dee-5bc62d3f6175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c09f8a-3a14-4946-af9e-16eaee19b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Volume 6f2cba30-6336-4794-9bf4-caf2c70bbf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76', 'volume_size': 1} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4361816a-798b-49f7-b786-df90f168df43 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:50 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 is being set with open permissions: ugo+rw Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:50 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 Nov 02 12:55:50 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (4a904cf8-e0ee-48f8-8352-47dc93097f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa107f57-964d-4b6b-ae7c-06624a0c08dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa107f57-964d-4b6b-ae7c-06624a0c08dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184695141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae439c4-e131-4993-bdfd-33bcf0e5518d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:50Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f2ca2-5527-454a-b0d7-3e3f4568f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f2ca2-5527-454a-b0d7-3e3f4568f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbbef00-4cbf-4473-b338-384e671cc7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbbef00-4cbf-4473-b338-384e671cc7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae439c4-e131-4993-bdfd-33bcf0e5518d', 'volume_name': 'volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b709fb-2a51-4edd-bfff-92ba4e66a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b709fb-2a51-4edd-bfff-92ba4e66a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f4f4d8-1140-4036-8e29-3ecbfc882a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:50 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume 8ae439c4-e131-4993-bdfd-33bcf0e5518d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d', 'volume_size': 1} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:50 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785" returned: 0 in 0.301s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:50 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:50 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info Nov 02 12:55:50 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:51 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:51 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info is being set with open permissions: ugo+rw Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:51 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info Nov 02 12:55:51 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:51 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.info" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2cba30-6336-4794-9bf4-caf2c70bbf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c311b0bb1949f2b2e05ee2606ff6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:50Z,use_quota=True,user_id='a2a9414588d944c0a878036ea6fdb571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Creating volume 6f2cba30-6336-4794-9bf4-caf2c70bbf76 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:51 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:51 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 1073741824 Nov 02 12:55:51 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:51 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a5bd4e56-bf8c-4381-b64c-debb478f9007 tempest-ProjectReaderTests-1423558856 None] Create snapshot completed successfully Nov 02 12:55:51 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 1073741824" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:51 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:51 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 Nov 02 12:55:51 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:52 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184695141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae439c4-e131-4993-bdfd-33bcf0e5518d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:50Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume 8ae439c4-e131-4993-bdfd-33bcf0e5518d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:52 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c09f8a-3a14-4946-af9e-16eaee19b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:52 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d 1073741824 Nov 02 12:55:52 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fdcdea-688f-4ce8-a0a8-e10f2d99fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Volume volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 (6f2cba30-6336-4794-9bf4-caf2c70bbf76): created successfully Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fdcdea-688f-4ce8-a0a8-e10f2d99fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Flow 'volume_create_manager' (3fbd375d-2219-44fc-9260-7303da6d8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:52 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5affc7bd-b8cf-4cd5-9aab-f1a163fa5af9 tempest-CinderUnicodeTest-746293324 None] Created volume successfully. Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-d93a86d7-a174-4df4-a4bc-c4cb8ef06785-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-d93a86d7-a174-4df4-a4bc-c4cb8ef06785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-d93a86d7-a174-4df4-a4bc-c4cb8ef06785" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-d93a86d7-a174-4df4-a4bc-c4cb8ef06785" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Deleting offline snapshot d93a86d7-a174-4df4-a4bc-c4cb8ef06785 of volume 4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] snapshot_file for this snap is: volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2bfe3-f920-4327-ab3f-206fe00b3c1a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:52 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 Nov 02 12:55:52 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:52 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d 1073741824" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:52 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d Nov 02 12:55:52 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:52 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4361816a-798b-49f7-b786-df90f168df43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6328e4-23b9-4e7c-8589-d6311bc4c977]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:52 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f4f4d8-1140-4036-8e29-3ecbfc882a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e26a11d-9ae9-4eee-9e8e-7087d5b0e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:52 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 Nov 02 12:55:52 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:52 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d (8ae439c4-e131-4993-bdfd-33bcf0e5518d): created successfully Nov 02 12:55:52 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e26a11d-9ae9-4eee-9e8e-7087d5b0e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:53 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (4a904cf8-e0ee-48f8-8352-47dc93097f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:53 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5d492618-3d07-4aa2-99b1-ab708141da3d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:55:53 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:53 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 Nov 02 12:55:53 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:53 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785" returned: 0 in 0.460s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:53 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:53 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785 Nov 02 12:55:53 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:54 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43.d93a86d7-a174-4df4-a4bc-c4cb8ef06785" returned: 0 in 0.358s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-d93a86d7-a174-4df4-a4bc-c4cb8ef06785" released by "_delete_snapshot" :: held 1.824s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" released by "delete_snapshot" :: held 1.863s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (b77389a6-2be8-40f3-aab1-176d4baf502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c80fd9-4190-413c-8301-4af76979ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Flow 'volume_create_manager' (b02de685-9294-4adb-8874-c40057b1b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642cedf6-db9a-472b-af21-156b0bb8751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c80fd9-4190-413c-8301-4af76979ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159088334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f75fafe-923d-4958-88cb-6cdd2fc8069a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1817753f-9e35-47e1-a8b1-68266aaac065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1817753f-9e35-47e1-a8b1-68266aaac065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014d9d30-3f29-4e80-b625-8b6a11873ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014d9d30-3f29-4e80-b625-8b6a11873ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f75fafe-923d-4958-88cb-6cdd2fc8069a', 'volume_name': 'volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a42cad9-e9ae-4c76-9b2e-a3a9bf9ff9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a42cad9-e9ae-4c76-9b2e-a3a9bf9ff9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6ea6ee-059f-4491-92a8-7942bd1a8a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume 8f75fafe-923d-4958-88cb-6cdd2fc8069a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a', 'volume_size': 1} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1159088334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f75fafe-923d-4958-88cb-6cdd2fc8069a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume 8f75fafe-923d-4958-88cb-6cdd2fc8069a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642cedf6-db9a-472b-af21-156b0bb8751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1739600111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd7314c-3d58-42b2-b527-428f6da06aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c311b0bb1949f2b2e05ee2606ff6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='a2a9414588d944c0a878036ea6fdb571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec61f428-bc86-4349-b9b1-e6845ef9d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a 1073741824 Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec61f428-bc86-4349-b9b1-e6845ef9d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404bdb27-b739-4898-9fc1-f3a7cafb0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404bdb27-b739-4898-9fc1-f3a7cafb0277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd7314c-3d58-42b2-b527-428f6da06aed', 'volume_name': 'volume-0fd7314c-3d58-42b2-b527-428f6da06aed', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a633b535-8a42-4685-9e07-8f28f3112cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a633b535-8a42-4685-9e07-8f28f3112cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963bb365-4f0f-4fee-8592-4288735e29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Volume 0fd7314c-3d58-42b2-b527-428f6da06aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd7314c-3d58-42b2-b527-428f6da06aed', 'volume_size': 1} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (d64e87c6-f63a-49e4-b575-c97f9996e659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b44e80f-0bd4-45a1-8ee0-5c7036978738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Created reservations ['5ec466a6-78b0-4b84-9afe-26407083d2a9', '38d986dd-19c7-40ca-bfd3-86995ebd2e49', '88cf0c0a-60a2-4dc9-9184-1742c3d62334', '5efb9cdf-0ef4-45bd-873e-6101abb8a544'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b44e80f-0bd4-45a1-8ee0-5c7036978738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178848335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6999d55f-685e-4d81-a7c5-f9b5d5afb72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7b05fa-a117-4246-b537-756e268ef793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7b05fa-a117-4246-b537-756e268ef793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857559c3-69e4-4514-870d-b1cce0be6cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857559c3-69e4-4514-870d-b1cce0be6cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6999d55f-685e-4d81-a7c5-f9b5d5afb72b', 'volume_name': 'volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b43953-f2b4-4488-851d-3a75e7809986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b43953-f2b4-4488-851d-3a75e7809986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515eb5f4-d346-42c8-adf3-72672ef4a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume 6999d55f-685e-4d81-a7c5-f9b5d5afb72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b', 'volume_size': 1} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Delete snapshot completed successfully. Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-487b64a3-31a9-4362-9ac5-20e3a6622656 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-d93a86d7-a174-4df4-a4bc-c4cb8ef06785-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-4361816a-798b-49f7-b786-df90f168df43-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-4361816a-798b-49f7-b786-df90f168df43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:55:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:55:55 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9ae57-289d-4f00-b0bb-5790a00c56d1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a 1073741824" returned: 0 in 0.750s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (188b53ab-a89f-4c03-a8d3-317d4082186f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaf0d96-c8e4-4b90-9e49-1c2f347c8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaf0d96-c8e4-4b90-9e49-1c2f347c8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370101361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:55Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a Nov 02 12:55:55 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1631818-5946-46ed-a287-40c633d513f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1631818-5946-46ed-a287-40c633d513f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3377df0d-971f-4b17-a238-fbe29f9e3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3377df0d-971f-4b17-a238-fbe29f9e3297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e', 'volume_name': 'volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a62d951-ad68-4977-811f-e8285ba4f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 Nov 02 12:55:55 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a62d951-ad68-4977-811f-e8285ba4f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76672e7-19b8-41d7-b82f-eaa4fda6850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume 7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e', 'volume_size': 1} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:55 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a" returned: 0 in 0.345s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1739600111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd7314c-3d58-42b2-b527-428f6da06aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c311b0bb1949f2b2e05ee2606ff6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='a2a9414588d944c0a878036ea6fdb571',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Creating volume 0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:55 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed 1073741824 Nov 02 12:55:55 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6ea6ee-059f-4491-92a8-7942bd1a8a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c380b6-e8db-47d5-9fa5-9be9e29bc4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (9e67f33b-8dd7-4094-9761-e6590f1179c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f62fe6a-a1b9-4072-a022-ed025c691065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43" returned: 0 in 0.596s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a (8f75fafe-923d-4958-88cb-6cdd2fc8069a): created successfully Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c380b6-e8db-47d5-9fa5-9be9e29bc4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (b77389a6-2be8-40f3-aab1-176d4baf502b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:55 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43 Nov 02 12:55:55 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f62fe6a-a1b9-4072-a022-ed025c691065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96005657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f941f777-b539-43b8-9a6f-6d44bc44bbb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:56Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6858f96b-8303-4a36-9abb-8e0c9b463b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6858f96b-8303-4a36-9abb-8e0c9b463b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88871217-4bc8-4494-af7c-f5daa3fd86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88871217-4bc8-4494-af7c-f5daa3fd86b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f941f777-b539-43b8-9a6f-6d44bc44bbb4', 'volume_name': 'volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dc214e-1fdc-4161-a8f1-9f74cea357fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dc214e-1fdc-4161-a8f1-9f74cea357fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0bf89a-ea56-4dc8-a4a7-774c0c37284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume f941f777-b539-43b8-9a6f-6d44bc44bbb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4', 'volume_size': 1} Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5eee6861-a557-4519-a2d1-644ad2831ec9 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:55:55 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4361816a-798b-49f7-b786-df90f168df43" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-4361816a-798b-49f7-b786-df90f168df43" released by "delete_volume" :: held 1.042s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (12ca3131-acf2-45c0-9b76-511d38b89b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a72408-7161-48c9-95af-6d526e63f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a72408-7161-48c9-95af-6d526e63f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-552842242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301c4d81-87c3-48a4-816b-28e05024fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:56Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7826a6e-ae0b-4461-be7f-32e81a76a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7826a6e-ae0b-4461-be7f-32e81a76a54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b2abd-75c4-45a8-b634-73eb9a673437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0b2abd-75c4-45a8-b634-73eb9a673437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301c4d81-87c3-48a4-816b-28e05024fa53', 'volume_name': 'volume-301c4d81-87c3-48a4-816b-28e05024fa53', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff2001f-d080-48fc-80b1-74f301fefdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff2001f-d080-48fc-80b1-74f301fefdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0267b0d-5780-4593-9fcb-3a29e683f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume 301c4d81-87c3-48a4-816b-28e05024fa53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301c4d81-87c3-48a4-816b-28e05024fa53', 'volume_size': 1} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:56 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed 1073741824" returned: 0 in 0.592s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Created reservations ['211bd09b-aabe-47b7-9098-18dc301132fd', '106c6aed-245c-4f9b-bf26-9dd88f46a33f', '21959fce-ca0f-4b57-a6dc-50b7d9a6cfe2', 'df8bcaec-79be-4b86-b0dd-2b3527c643a0'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:56 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed Nov 02 12:55:56 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:56 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:55:56 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:56 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178848335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6999d55f-685e-4d81-a7c5-f9b5d5afb72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:54Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume 6999d55f-685e-4d81-a7c5-f9b5d5afb72b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:56 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:56 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b 1073741824 Nov 02 12:55:56 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:56 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963bb365-4f0f-4fee-8592-4288735e29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd7314c-3d58-42b2-b527-428f6da06aed', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be42401-978b-4eeb-a00d-b37c75a38575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:55:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Deleted volume successfully. Nov 02 12:55:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Volume volume-0fd7314c-3d58-42b2-b527-428f6da06aed (0fd7314c-3d58-42b2-b527-428f6da06aed): created successfully Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be42401-978b-4eeb-a00d-b37c75a38575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Flow 'volume_create_manager' (b02de685-9294-4adb-8874-c40057b1b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:56 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7043587a-3025-4904-8b1f-1b9aca73e705 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-4361816a-798b-49f7-b786-df90f168df43-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:55:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-5b33524e-0360-4942-acf4-a521e8ace78f tempest-CinderUnicodeTest-746293324 None] Created volume successfully. Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (f3fcb137-d3fe-4d52-899a-05cc9ab3df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:57 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ff795-2405-49a9-bf08-1391287db989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b 1073741824" returned: 0 in 0.602s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ff795-2405-49a9-bf08-1391287db989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148242880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf3e561-56b0-414d-a2e0-bdc2386ba6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:57Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcbc91d-ed60-4c80-a1b5-578ae3d01e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcbc91d-ed60-4c80-a1b5-578ae3d01e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86ece43-2673-4cab-9317-a819c58ca177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86ece43-2673-4cab-9317-a819c58ca177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf3e561-56b0-414d-a2e0-bdc2386ba6a8', 'volume_name': 'volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757342cd-d8f2-4e78-ab4d-d195ea88f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757342cd-d8f2-4e78-ab4d-d195ea88f36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d742f5-8279-4a89-9034-041ebc62df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Volume 2cf3e561-56b0-414d-a2e0-bdc2386ba6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8', 'volume_size': 1} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:57 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b Nov 02 12:55:57 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:57 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.181s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370101361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:55Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume 7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:57 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:57 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e 1073741824 Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:57 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515eb5f4-d346-42c8-adf3-72672ef4a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5653d09a-6a44-4364-b37f-0b5e36dfbb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:57 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b (6999d55f-685e-4d81-a7c5-f9b5d5afb72b): created successfully Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5653d09a-6a44-4364-b37f-0b5e36dfbb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:57 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (d64e87c6-f63a-49e4-b575-c97f9996e659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-02bcf922-5816-4c83-97d1-03c01150bf03 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:55:58 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e 1073741824" returned: 0 in 0.522s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:58 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e Nov 02 12:55:58 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:58 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96005657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f941f777-b539-43b8-9a6f-6d44bc44bbb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:56Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume f941f777-b539-43b8-9a6f-6d44bc44bbb4 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:58 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76672e7-19b8-41d7-b82f-eaa4fda6850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:58 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 1073741824 Nov 02 12:55:58 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da027a6-cad2-428d-b66f-1bc6e57600d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:58 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e (7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e): created successfully Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da027a6-cad2-428d-b66f-1bc6e57600d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (188b53ab-a89f-4c03-a8d3-317d4082186f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d9d640af-5626-479f-a128-131bb60dcf17 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:55:58 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 1073741824" returned: 0 in 0.469s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:58 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 Nov 02 12:55:58 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:59 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.962s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-552842242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301c4d81-87c3-48a4-816b-28e05024fa53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500e6ed43a69477e85653500663dc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:56Z,use_quota=True,user_id='7bd93db1d05e42bf8e4ef42fc39edc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Creating volume 301c4d81-87c3-48a4-816b-28e05024fa53 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0bf89a-ea56-4dc8-a4a7-774c0c37284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554741-70c6-453c-b8e5-e849532f197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:55:59 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 1073741824 Nov 02 12:55:59 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 (f941f777-b539-43b8-9a6f-6d44bc44bbb4): created successfully Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554741-70c6-453c-b8e5-e849532f197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (9e67f33b-8dd7-4094-9761-e6590f1179c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:55:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8f35efe0-2aa4-483a-b193-25e5f769dabc tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:55:59 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 1073741824" returned: 0 in 0.496s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:55:59 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 Nov 02 12:55:59 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:55:59 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.780s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148242880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf3e561-56b0-414d-a2e0-bdc2386ba6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:55:57Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Creating volume 2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:55:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:55:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0267b0d-5780-4593-9fcb-3a29e683f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301c4d81-87c3-48a4-816b-28e05024fa53', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 1073741824 Nov 02 12:56:00 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82027b48-ad19-4362-8a0a-361f0319a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Volume volume-301c4d81-87c3-48a4-816b-28e05024fa53 (301c4d81-87c3-48a4-816b-28e05024fa53): created successfully Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82027b48-ad19-4362-8a0a-361f0319a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Flow 'volume_create_manager' (12ca3131-acf2-45c0-9b76-511d38b89b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3f81f438-7175-4f9e-9420-981fccfe8015 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created volume successfully. Nov 02 12:56:00 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 1073741824" returned: 0 in 0.516s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-301c4d81-87c3-48a4-816b-28e05024fa53-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-301c4d81-87c3-48a4-816b-28e05024fa53-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:00 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 Nov 02 12:56:00 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-301c4d81-87c3-48a4-816b-28e05024fa53" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-301c4d81-87c3-48a4-816b-28e05024fa53" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654ea7b-806a-4a66-9c1d-948def62fae6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Flow 'volume_create_manager' (f2beae6c-1c39-492f-888a-c0b1ba592005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f5999-d6a0-4d53-83c9-2a9f181ebc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 Nov 02 12:56:00 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08f5999-d6a0-4d53-83c9-2a9f181ebc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608458650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f132cedc-883b-4059-8966-64e84f97b762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbdd2d0ebc04191af7512c7a05f668f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:01Z,use_quota=True,user_id='1b08dd8a6b124e9db52089ae14acda11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e04c6c-a116-40da-af23-d00b1cc0ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e04c6c-a116-40da-af23-d00b1cc0ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22c3b17-a91f-4978-9d59-cdba5f8559e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22c3b17-a91f-4978-9d59-cdba5f8559e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f132cedc-883b-4059-8966-64e84f97b762', 'volume_name': 'volume-f132cedc-883b-4059-8966-64e84f97b762', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b862a78-4b78-4dfb-8c26-12ceb5e9d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b862a78-4b78-4dfb-8c26-12ceb5e9d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d56c28-66f0-4afc-84c3-cfdc0203c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Volume f132cedc-883b-4059-8966-64e84f97b762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f132cedc-883b-4059-8966-64e84f97b762', 'volume_size': 1} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.330s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d742f5-8279-4a89-9034-041ebc62df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967c5a7a-b54f-47da-acef-b62b8704192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Creating offline snapshot f421bca7-046b-4ba9-8c0a-0ed782cc894e of volume 0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Volume volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 (2cf3e561-56b0-414d-a2e0-bdc2386ba6a8): created successfully Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967c5a7a-b54f-47da-acef-b62b8704192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (f3fcb137-d3fe-4d52-899a-05cc9ab3df73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[17054f7a-7174-4ee3-91ee-f08d280131a6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-99a75e48-173d-460f-ae3a-e4b166e59b5c tempest-ProjectReaderTests-1423558856 None] Created volume successfully. Nov 02 12:56:01 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed Nov 02 12:56:01 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:01 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53" returned: 0 in 0.407s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:01 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53 Nov 02 12:56:01 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:01 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:01 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:01 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e 1G Nov 02 12:56:01 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-301c4d81-87c3-48a4-816b-28e05024fa53" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-301c4d81-87c3-48a4-816b-28e05024fa53" released by "delete_volume" :: held 0.759s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['533fa459-3ffc-420d-ba46-1ef460e4e01f', '1e060504-780d-418f-ad26-c493871d82bb', '8d15c21a-a7ce-4dbb-8570-263e3b662b5e', '95f0608d-3807-4346-80e9-b333db9463f8'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:01 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:01 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-f941f777-b539-43b8-9a6f-6d44bc44bbb4-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-f941f777-b539-43b8-9a6f-6d44bc44bbb4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-f941f777-b539-43b8-9a6f-6d44bc44bbb4" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-f941f777-b539-43b8-9a6f-6d44bc44bbb4" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb909b-53a1-4be5-8197-846eca7eb292]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:01 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:01 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e 1G" returned: 0 in 0.503s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd7314c-3d58-42b2-b527-428f6da06aed -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:01 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd7314c-3d58-42b2-b527-428f6da06aed -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e Nov 02 12:56:01 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-18e9185b-5e32-428b-8ff9-a4c10c78bf90 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-301c4d81-87c3-48a4-816b-28e05024fa53-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:01 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 Nov 02 12:56:01 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd7314c-3d58-42b2-b527-428f6da06aed -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e" returned: 0 in 0.293s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e is being set with open permissions: ugo+rw Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:02 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e Nov 02 12:56:02 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4" returned: 0 in 0.400s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:02 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4 Nov 02 12:56:02 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e" returned: 0 in 0.268s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:02 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info Nov 02 12:56:02 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f941f777-b539-43b8-9a6f-6d44bc44bbb4" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-f941f777-b539-43b8-9a6f-6d44bc44bbb4" released by "delete_volume" :: held 0.718s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['42138263-4293-4737-b09f-ea0391ba54c1', '45945063-daad-4c53-89b7-bd8d0e6655d4', 'be967c5a-18bc-4801-aa14-639d9260747b', '97ef6acc-c46d-492a-b39e-9789f5c86605'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:02 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:02 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info is being set with open permissions: ugo+rw Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:02 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info Nov 02 12:56:02 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:02 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.266s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:02 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a285a634-f677-443f-82d5-604e24c63825 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-f941f777-b539-43b8-9a6f-6d44bc44bbb4-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:03 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.info" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b26698-dfc2-472b-94ac-63a4e32bb809]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608458650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f132cedc-883b-4059-8966-64e84f97b762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbdd2d0ebc04191af7512c7a05f668f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:01Z,use_quota=True,user_id='1b08dd8a6b124e9db52089ae14acda11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Creating volume f132cedc-883b-4059-8966-64e84f97b762 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:03 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 1073741824 Nov 02 12:56:03 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fb7d6140-b898-4735-9348-1e26f68c5c56 tempest-CinderUnicodeTest-746293324 None] Create snapshot completed successfully Nov 02 12:56:03 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e Nov 02 12:56:03 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:03 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:03 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e Nov 02 12:56:03 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:03 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 1073741824" returned: 0 in 0.457s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:03 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 Nov 02 12:56:03 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:03 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" returned: 0 in 0.261s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e" released by "delete_volume" :: held 0.731s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['d3171aac-69cb-4e5d-980b-190379992f73', 'e5774517-833f-40b5-ae90-180ad0623e31', '00b34d4e-6357-4be3-a093-541ec4480833', '56767270-d6b9-4831-8acc-53a3e636f4f6'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-f421bca7-046b-4ba9-8c0a-0ed782cc894e-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:03 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.386s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-f421bca7-046b-4ba9-8c0a-0ed782cc894e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d56c28-66f0-4afc-84c3-cfdc0203c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f132cedc-883b-4059-8966-64e84f97b762', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6febc868-a9d3-409a-a40c-9fea5b66bcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Creating offline snapshot dad2b214-7730-42e0-9d42-7f3eff2ec986 of volume 2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-quobyte-f421bca7-046b-4ba9-8c0a-0ed782cc894e" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Volume volume-f132cedc-883b-4059-8966-64e84f97b762 (f132cedc-883b-4059-8966-64e84f97b762): created successfully Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6febc868-a9d3-409a-a40c-9fea5b66bcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Flow 'volume_create_manager' (f2beae6c-1c39-492f-888a-c0b1ba592005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4ccc1-dd3a-4983-8176-6634099e047d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-f421bca7-046b-4ba9-8c0a-0ed782cc894e" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Deleting offline snapshot f421bca7-046b-4ba9-8c0a-0ed782cc894e of volume 0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] snapshot_file for this snap is: volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-726b0b83-85fb-44a6-a616-ce448d93152d tempest-ProjectReaderTests-808429004 None] Created volume successfully. Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d3e31f-ee20-4130-897a-8615e19c16d2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:04 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 Nov 02 12:56:04 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-6999d55f-685e-4d81-a7c5-f9b5d5afb72b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:04 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-6999d55f-685e-4d81-a7c5-f9b5d5afb72b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:04 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755a97e-da2b-4371-86ae-ae2a7d5e9285]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.315s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b773df08-75aa-4a0e-a9ed-ffb128f2ec5d tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-7dfea0c4-68a6-45b7-9a6e-eec1abc6a10e-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:04 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b Nov 02 12:56:04 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 1G Nov 02 12:56:04 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd7314c-3d58-42b2-b527-428f6da06aed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e0c42-33b7-4dcc-a0d8-9a2aeabecd05]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed Nov 02 12:56:04 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b Nov 02 12:56:04 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:04 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 1G" returned: 0 in 0.512s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:04 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed" returned: 0 in 0.454s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 Nov 02 12:56:05 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e Nov 02 12:56:05 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-6999d55f-685e-4d81-a7c5-f9b5d5afb72b" released by "delete_volume" :: held 0.804s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['afe4da5f-116e-4629-91b9-d08f92417ecd', '2eaf1709-c940-4dd0-84e1-d023a9b95cfd', '4e36bbfe-a66f-43df-a221-0d36b1a29352', '7aae5e5e-5fc8-4e9a-9b00-56e400cfee92'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Acquiring lock "cinder-f132cedc-883b-4059-8966-64e84f97b762-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "cinder-f132cedc-883b-4059-8966-64e84f97b762-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Acquiring lock "cinder-quobyte-f132cedc-883b-4059-8966-64e84f97b762" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "cinder-quobyte-f132cedc-883b-4059-8966-64e84f97b762" acquired by "delete_volume" :: waited 0.057s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:05 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:05 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6030b5-ff94-4e07-8705-7422d3153cc4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-8f75fafe-923d-4958-88cb-6cdd2fc8069a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-8f75fafe-923d-4958-88cb-6cdd2fc8069a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:05 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986" returned: 0 in 0.482s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 is being set with open permissions: ugo+rw Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e" returned: 0 in 0.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-8f75fafe-923d-4958-88cb-6cdd2fc8069a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:05 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 Nov 02 12:56:05 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e Nov 02 12:56:05 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-8f75fafe-923d-4958-88cb-6cdd2fc8069a" acquired by "delete_volume" :: waited 0.028s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:05 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 Nov 02 12:56:05 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3471016-6613-409b-a4a6-02353612bc68]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a Nov 02 12:56:05 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.470s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0e75636d-9415-4847-9bc9-3040b34ca054 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-6999d55f-685e-4d81-a7c5-f9b5d5afb72b-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:05 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed.f421bca7-046b-4ba9-8c0a-0ed782cc894e" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-f421bca7-046b-4ba9-8c0a-0ed782cc894e" released by "_delete_snapshot" :: held 1.892s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" released by "delete_snapshot" :: held 1.961s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:05 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762" returned: 0 in 0.574s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:05 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info Nov 02 12:56:05 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:05 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762 Nov 02 12:56:05 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Created reservations ['a1a2cdcb-48bd-446c-b39e-65e07c166e73', '3120e631-a3f7-4743-a579-92757919bf05', 'ad7796bc-b920-4bc9-9e78-a488a48ac693', '61125167-9897-4771-ac91-51a203ce5906'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:06 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a" returned: 0 in 0.450s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a Nov 02 12:56:06 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Delete snapshot completed successfully. Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ec6315ab-2d0d-42fd-8d23-89b08ec0a307 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-f421bca7-046b-4ba9-8c0a-0ed782cc894e-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:06 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info is being set with open permissions: ugo+rw Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-f132cedc-883b-4059-8966-64e84f97b762" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info Nov 02 12:56:06 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "cinder-quobyte-f132cedc-883b-4059-8966-64e84f97b762" released by "delete_volume" :: held 0.962s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Created reservations ['6ce428d0-7c46-4d52-bbc7-3c92f47190b3', 'f2bf483a-d425-4fdd-bb4c-69f911276534', '9411a36d-b6d8-4152-b117-da72be58bc82', 'e4b58fe7-fadf-4ac4-b473-cdbaf7e1f163'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:06 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8f75fafe-923d-4958-88cb-6cdd2fc8069a" returned: 0 in 0.311s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-8f75fafe-923d-4958-88cb-6cdd2fc8069a" released by "delete_volume" :: held 0.843s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:06 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['5708948f-a1f2-4317-9fce-88d411a6eb1d', '2596ba4f-6356-4b77-9a72-9cec657481c9', '04b933aa-b70f-4e6a-a83d-8f0913a036b5', '57eb5c9e-303d-42cd-a59b-044f1037c665'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:06 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.info" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:06 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-8ae439c4-e131-4993-bdfd-33bcf0e5518d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e8ea444d-704d-40d1-a08c-ddfcaf3d146c tempest-ProjectReaderTests-1423558856 None] Create snapshot completed successfully Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-8ae439c4-e131-4993-bdfd-33bcf0e5518d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:06 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "cinder-quobyte-8ae439c4-e131-4993-bdfd-33bcf0e5518d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Deleted volume successfully. Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-8ae439c4-e131-4993-bdfd-33bcf0e5518d" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-dad2b214-7730-42e0-9d42-7f3eff2ec986-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0c8dcb61-b972-4250-888b-8ef6946c8fa3 tempest-ProjectReaderTests-808429004 None] Lock "cinder-f132cedc-883b-4059-8966-64e84f97b762-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108142c-0f5d-4a63-96d4-10a3a91d96c1]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-dad2b214-7730-42e0-9d42-7f3eff2ec986-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-dad2b214-7730-42e0-9d42-7f3eff2ec986" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-dad2b214-7730-42e0-9d42-7f3eff2ec986" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Deleting offline snapshot dad2b214-7730-42e0-9d42-7f3eff2ec986 of volume 2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:06 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] snapshot_file for this snap is: volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:06 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978d2f8-ce01-496a-bac9-9ae5a1419164]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-626bfd0a-b94d-42c8-8c61-0f01a3383d5b tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-8f75fafe-923d-4958-88cb-6cdd2fc8069a-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:06 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d Nov 02 12:56:06 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 Nov 02 12:56:07 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-0fd7314c-3d58-42b2-b527-428f6da06aed-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-0fd7314c-3d58-42b2-b527-428f6da06aed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:UPDATE=326,cinder:SELECT=232,cinder:INSERT=80,cinder:DELETE=27 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5e19d-7fbf-4155-aa17-3ec892d6358e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d Nov 02 12:56:07 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:07 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed Nov 02 12:56:07 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8465fc-0576-4393-a5fb-e76c0a121668]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 Nov 02 12:56:07 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-8ae439c4-e131-4993-bdfd-33bcf0e5518d" returned: 0 in 0.300s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-quobyte-8ae439c4-e131-4993-bdfd-33bcf0e5518d" released by "delete_volume" :: held 0.806s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=228,cinder:UPDATE=297,cinder:DELETE=30,cinder:INSERT=80 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Created reservations ['4ae4770b-86c8-4d78-bb63-5a44a0eb920b', '26a6f35e-749b-42af-b70a-cc5d7852306b', '470c4810-e9e4-4215-9aa4-4b809becb82c', 'f4f0f7c3-4eb1-4123-8f87-9722ec458702'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:07 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed" returned: 0 in 0.439s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed Nov 02 12:56:07 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:07 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:07 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" returned: 0 in 0.475s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:07 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 Nov 02 12:56:07 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:08 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-0fd7314c-3d58-42b2-b527-428f6da06aed" returned: 0 in 0.380s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-0fd7314c-3d58-42b2-b527-428f6da06aed" released by "delete_volume" :: held 0.916s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Flow 'volume_create_manager' (4e2d1845-1e4c-4d88-8f56-e4af10707279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a289276-8d1d-4f91-994a-a519eca539b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:08 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.446s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a289276-8d1d-4f91-994a-a519eca539b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334164722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1863c23c-7afc-4887-8279-883648e06361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbdd2d0ebc04191af7512c7a05f668f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:08Z,use_quota=True,user_id='1b08dd8a6b124e9db52089ae14acda11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96201c1a-8164-449a-9d9e-e218a4ff9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96201c1a-8164-449a-9d9e-e218a4ff9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7519ada-036e-4ce1-a7f3-f6906cc03f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7519ada-036e-4ce1-a7f3-f6906cc03f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1863c23c-7afc-4887-8279-883648e06361', 'volume_name': 'volume-1863c23c-7afc-4887-8279-883648e06361', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6ad06-d7cd-401c-ac61-a4e030c4f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6ad06-d7cd-401c-ac61-a4e030c4f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91255900-53ee-4759-890b-369c896d5422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:08 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Volume 1863c23c-7afc-4887-8279-883648e06361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1863c23c-7afc-4887-8279-883648e06361', 'volume_size': 1} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334164722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1863c23c-7afc-4887-8279-883648e06361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efbdd2d0ebc04191af7512c7a05f668f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:08Z,use_quota=True,user_id='1b08dd8a6b124e9db52089ae14acda11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Creating volume 1863c23c-7afc-4887-8279-883648e06361 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Deleted volume successfully. Nov 02 12:56:08 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 1073741824 Nov 02 12:56:08 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Created reservations ['7a618665-4fc6-4c67-ae7b-7d3864a483a6', '1f1afa9f-1609-42a4-b421-d7bc6f730a3c', '51c728c2-b80e-4190-9320-bbb38b9dbe33', '10b8a60e-81e1-4f7d-b00c-da2f1b44ac92'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-c998f247-e891-417a-b080-54fd0104e4d5 tempest-CreateVolumesFromSourceVolumeTest-1919713193 None] Lock "cinder-8ae439c4-e131-4993-bdfd-33bcf0e5518d-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:08 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986" returned: 0 in 0.589s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:08 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:08 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:08 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986 Nov 02 12:56:08 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:08 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:08 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8.dad2b214-7730-42e0-9d42-7f3eff2ec986" returned: 0 in 0.310s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Deleted volume successfully. Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-dad2b214-7730-42e0-9d42-7f3eff2ec986" released by "_delete_snapshot" :: held 1.951s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" released by "delete_snapshot" :: held 1.978s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-893b2a85-1839-44b8-b020-07a5f2c31b12 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-0fd7314c-3d58-42b2-b527-428f6da06aed-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 1073741824" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Created reservations ['7570ea70-e79b-4aa9-82cc-073a3d874982', '521faf71-eb98-4eaa-9746-8059df5a9674', '1416f1c4-b4ab-4f95-95da-a4ef84244842', 'f85d695f-5a83-4687-8be7-302fb1ee9d10'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:08 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 Nov 02 12:56:08 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Delete snapshot completed successfully. Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-26e476dc-1e73-44c5-9e3c-f4a016ddf8a1 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-dad2b214-7730-42e0-9d42-7f3eff2ec986-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:08 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde0ee4c-2396-4954-8014-467a94440bda]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:09 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361" returned: 0 in 0.348s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91255900-53ee-4759-890b-369c896d5422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1863c23c-7afc-4887-8279-883648e06361', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:09 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 Nov 02 12:56:09 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ba1dc9-bd98-49bb-b79d-d6f067431c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Volume volume-1863c23c-7afc-4887-8279-883648e06361 (1863c23c-7afc-4887-8279-883648e06361): created successfully Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ba1dc9-bd98-49bb-b79d-d6f067431c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Flow 'volume_create_manager' (4e2d1845-1e4c-4d88-8f56-e4af10707279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7d6a52e8-bf6b-4434-b978-506ea36f28c3 tempest-ProjectReaderTests-808429004 None] Created volume successfully. Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-6f2cba30-6336-4794-9bf4-caf2c70bbf76-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-6f2cba30-6336-4794-9bf4-caf2c70bbf76-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "cinder-quobyte-6f2cba30-6336-4794-9bf4-caf2c70bbf76" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-6f2cba30-6336-4794-9bf4-caf2c70bbf76" acquired by "delete_volume" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ac468-eb8b-4493-a31a-b018c735ccef]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:09 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" returned: 0 in 0.459s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:09 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 Nov 02 12:56:09 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:09 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8 Nov 02 12:56:09 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:09 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:09 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" returned: 0 in 0.285s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8" released by "delete_volume" :: held 0.851s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:09 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76 Nov 02 12:56:09 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:09 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Created reservations ['7c86e4e7-2233-49d8-a0f7-1ec0f18d4f81', 'a904d61c-2caa-475c-9139-fed42134d33c', 'e60232c4-798b-404d-9ec8-5caf3de058f4', '2143c482-ebb6-4f78-bb8f-9ff26d5f3323'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:10 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:10 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:10 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-6f2cba30-6336-4794-9bf4-caf2c70bbf76" returned: 0 in 0.316s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-quobyte-6f2cba30-6336-4794-9bf4-caf2c70bbf76" released by "delete_volume" :: held 0.793s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Acquiring lock "cinder-1863c23c-7afc-4887-8279-883648e06361-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Created reservations ['61ffe325-ca86-40e9-97df-c7e45902211a', '73ba85ca-31d7-44a3-a34e-a294a6b1045f', '4038bc5e-ad7c-429f-9631-28efdeeb16b9', '6fd567fd-022b-47bb-a7e2-3d8312398ec1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "cinder-1863c23c-7afc-4887-8279-883648e06361-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Acquiring lock "cinder-quobyte-1863c23c-7afc-4887-8279-883648e06361" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "cinder-quobyte-1863c23c-7afc-4887-8279-883648e06361" acquired by "delete_volume" :: waited 0.036s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:10 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.444s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:10 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Deleted volume successfully. Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c88b793-d641-4a1c-a84c-6099d471eca9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a964f91-2849-4b8d-8af0-62683da64139 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-2cf3e561-56b0-414d-a2e0-bdc2386ba6a8-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:10 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:10 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:10 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 Nov 02 12:56:10 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:11 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (9474ef8e-3a69-49ac-9217-6e45651488e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c1236e-fde0-409d-a3f1-9fd72081a243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Deleted volume successfully. Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c1236e-fde0-409d-a3f1-9fd72081a243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642019068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b762b047-b7c0-4161-9809-afe33e3c5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:11Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9825ced-7a3b-41d4-8c50-c20006baeeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9825ced-7a3b-41d4-8c50-c20006baeeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6de9a64-dc67-44ee-9826-158c463c3fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6de9a64-dc67-44ee-9826-158c463c3fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b762b047-b7c0-4161-9809-afe33e3c5fdc', 'volume_name': 'volume-b762b047-b7c0-4161-9809-afe33e3c5fdc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cbc075-b7e9-4613-9548-0b70c7030bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cbc075-b7e9-4613-9548-0b70c7030bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eef37f2-a439-4286-b0be-40b5323ff60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:11 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Volume b762b047-b7c0-4161-9809-afe33e3c5fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b762b047-b7c0-4161-9809-afe33e3c5fdc', 'volume_size': 1} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-642019068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b762b047-b7c0-4161-9809-afe33e3c5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='828113ebddbf4fc1a518947c57335c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:11Z,use_quota=True,user_id='6e4bd997515443ac835108a161aab8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Creating volume b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:11 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:11 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361" returned: 0 in 0.629s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:11 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc 1073741824 Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:11 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2f618f5-751d-45e7-b1d3-cf508f783e37 tempest-CinderUnicodeTest-746293324 None] Lock "cinder-6f2cba30-6336-4794-9bf4-caf2c70bbf76-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:11 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361 Nov 02 12:56:11 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:11 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-1863c23c-7afc-4887-8279-883648e06361" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "cinder-quobyte-1863c23c-7afc-4887-8279-883648e06361" released by "delete_volume" :: held 1.149s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Created reservations ['35bf215b-a07c-4d5a-88f8-234c6b212681', 'b8cd8b61-3bc9-4dc6-9b47-acd89507d5ff', 'c5a941e0-46b8-442b-b4fd-4875286e3ddf', 'd358ecd3-7bc7-4b7f-b42c-51317ffdc620'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:11 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc 1073741824" returned: 0 in 0.650s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:11 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:11 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:11 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc Nov 02 12:56:11 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:12 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.391s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Deleted volume successfully. Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-6db7c976-4432-4519-98f6-904de783217d tempest-ProjectReaderTests-808429004 None] Lock "cinder-1863c23c-7afc-4887-8279-883648e06361-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:12 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc" returned: 0 in 0.388s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eef37f2-a439-4286-b0be-40b5323ff60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b762b047-b7c0-4161-9809-afe33e3c5fdc', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72748e81-38d1-4609-840c-ad2b72b43d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:12 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Volume volume-b762b047-b7c0-4161-9809-afe33e3c5fdc (b762b047-b7c0-4161-9809-afe33e3c5fdc): created successfully Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72748e81-38d1-4609-840c-ad2b72b43d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:12 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Flow 'volume_create_manager' (9474ef8e-3a69-49ac-9217-6e45651488e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1695ee3e-084d-4359-9917-c2ab380bf4b0 tempest-ProjectReaderTests-1423558856 None] Created volume successfully. Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Creating offline snapshot f0b5dc47-b37d-4089-a0a4-ee959297f6fa of volume b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2581a713-18dd-4b1a-9424-c851b786260f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:13 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc Nov 02 12:56:13 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:13 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:13 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa 1G Nov 02 12:56:13 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:14 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa 1G" returned: 0 in 0.580s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b762b047-b7c0-4161-9809-afe33e3c5fdc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:14 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b762b047-b7c0-4161-9809-afe33e3c5fdc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa Nov 02 12:56:14 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:14 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b762b047-b7c0-4161-9809-afe33e3c5fdc -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:14 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa is being set with open permissions: ugo+rw Nov 02 12:56:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:14 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-fbf4ab22-f4c5-42a9-8cc6-8b74d5ac6571 tempest-ProjectAdminTests-1145021111 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8107223510742, 'free_capacity_gb': 1773.8107223510742, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86731) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:56:14 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa Nov 02 12:56:14 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:15 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:15 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info Nov 02 12:56:15 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:15 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info is being set with open permissions: ugo+rw Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:15 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info Nov 02 12:56:15 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Flow 'volume_create_manager' (49582f65-2bc5-4ea4-9c15-1619e6d5bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4754eae-ac3d-4e5b-82f4-ca9fc3c1dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4754eae-ac3d-4e5b-82f4-ca9fc3c1dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e853cf-daeb-471f-a58e-9b3aaf950f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790e3ca9b6d2443380d49ceb78145aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:15Z,use_quota=True,user_id='30bdbfffd5af496eb4fefa30bb866520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2432e46-5766-4894-90c4-d697f6863403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2432e46-5766-4894-90c4-d697f6863403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1853c96b-749c-4145-a08f-1a1406b3fe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG cinder.image.glance [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Creating Keystone auth plugin from conf {{(pid=86731) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:56:15 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.info" returned: 0 in 0.296s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:15 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c1788227-9054-4b4d-bc38-ca8cda8d44a3 tempest-ProjectReaderTests-1423558856 None] Create snapshot completed successfully Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1853c96b-749c-4145-a08f-1a1406b3fe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5e853cf-daeb-471f-a58e-9b3aaf950f13', 'volume_name': 'volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13', 'volume_size': 1, 'image_id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d09903250b2942668d79bef7e2ac035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '790e3ca9b6d2443380d49ceb78145aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49cf421fe3b753afa54230ac91fceb79585b3d39fc32c5c23eff9c580e8c8dbf7cc1d89c8a6bcf2112bdaa96dc72816d28154170d49ca9f20ccf2ffdde502c9c', 'id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'created_at': datetime.datetime(2026, 11, 2, 11, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bfff7cc-529c-4b6a-9790-c03327271ccc/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfd71a6-8dea-4fd4-9253-4cf4638b8b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfd71a6-8dea-4fd4-9253-4cf4638b8b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8dcd1a-fbbf-4bb4-923e-2a46ee7a76b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:16 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Volume a5e853cf-daeb-471f-a58e-9b3aaf950f13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13', 'volume_size': 1, 'image_id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d09903250b2942668d79bef7e2ac035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '790e3ca9b6d2443380d49ceb78145aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49cf421fe3b753afa54230ac91fceb79585b3d39fc32c5c23eff9c580e8c8dbf7cc1d89c8a6bcf2112bdaa96dc72816d28154170d49ca9f20ccf2ffdde502c9c', 'id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'created_at': datetime.datetime(2026, 11, 2, 11, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bfff7cc-529c-4b6a-9790-c03327271ccc/file', 'properties': {}}, 'image_service': } Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Trying to clone a5e853cf-daeb-471f-a58e-9b3aaf950f13 from image 6bfff7cc-529c-4b6a-9790-c03327271ccc at location (None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}]). {{(pid=86731) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Nov 02 12:56:16 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0e715-da60-4bf4-b34f-ee56a1f95627]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:16 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:16 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-f0b5dc47-b37d-4089-a0a4-ee959297f6fa-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-f0b5dc47-b37d-4089-a0a4-ee959297f6fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-f0b5dc47-b37d-4089-a0a4-ee959297f6fa" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-f0b5dc47-b37d-4089-a0a4-ee959297f6fa" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Deleting offline snapshot f0b5dc47-b37d-4089-a0a4-ee959297f6fa of volume b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] snapshot_file for this snap is: volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b46d46b-c14e-4f46-ac9f-865d09953c69]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:16 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:16 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa Nov 02 12:56:16 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:16 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:16 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa" returned: 0 in 0.415s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b762b047-b7c0-4161-9809-afe33e3c5fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[db994b2f-b022-45b6-922f-25cb596fde44]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:17 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Temporary image 6bfff7cc-529c-4b6a-9790-c03327271ccc is fetched for user 30bdbfffd5af496eb4fefa30bb866520. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694bdf6-c9f8-494a-860c-0ecc869a7ad5]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:17 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc Nov 02 12:56:17 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:17 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc" returned: 0 in 0.392s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:17 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa Nov 02 12:56:17 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:17 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:17 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:17 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa Nov 02 12:56:17 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:17 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e853cf-daeb-471f-a58e-9b3aaf950f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790e3ca9b6d2443380d49ceb78145aab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:15Z,use_quota=True,user_id='30bdbfffd5af496eb4fefa30bb866520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Creating volume a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:17 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:18 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1073741824 Nov 02 12:56:18 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:18 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc.f0b5dc47-b37d-4089-a0a4-ee959297f6fa" returned: 0 in 0.317s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-f0b5dc47-b37d-4089-a0a4-ee959297f6fa" released by "_delete_snapshot" :: held 1.666s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" released by "delete_snapshot" :: held 1.706s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Created reservations ['5b069b38-1e32-45a9-a05d-dc7ebdc6f6bf', '0e9ce92f-b362-4c08-8835-ed853920b71e', '206a628e-2f3e-4ce4-a694-ec8315d1696a', '63283f0b-09dc-4824-9d9a-3204d4b44e70'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:18 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Delete snapshot completed successfully. Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-9a015509-ebf9-4e17-8899-ce1ea581c908 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-f0b5dc47-b37d-4089-a0a4-ee959297f6fa-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:18 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1073741824" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:18 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 Nov 02 12:56:18 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-b762b047-b7c0-4161-9809-afe33e3c5fdc-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-b762b047-b7c0-4161-9809-afe33e3c5fdc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0a9a4c-9072-476f-b818-e44f979dd6c4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:18 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Attempting download of 6bfff7cc-529c-4b6a-9790-c03327271ccc ((None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}])) to volume a5e853cf-daeb-471f-a58e-9b3aaf950f13. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1192}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b994a874-b4ec-49f5-9237-46107f62e95c]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:18 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc Nov 02 12:56:18 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:19 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u Nov 02 12:56:19 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:19 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc" returned: 0 in 0.436s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:19 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc Nov 02 12:56:19 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:19 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u Nov 02 12:56:19 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:19 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-b762b047-b7c0-4161-9809-afe33e3c5fdc" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-quobyte-b762b047-b7c0-4161-9809-afe33e3c5fdc" released by "delete_volume" :: held 0.803s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Created reservations ['678b4943-125f-4bff-8e12-7a71d69c4b0a', '049bd133-f021-4a5b-8e6c-e132bef5fad5', '6a47eb59-41f9-42a5-9cb6-0a8253297870', '9b6f3275-4c0d-4c5c-ad2f-2acf18457f41'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:19 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u" returned: 1 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6bfff7cc-529c-4b6a-9790-c03327271ccc_0a6wfx1u' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e3a536-3750-42cf-bb45-f51ef8916b86]: (4, 'raw') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:19 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:19 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:19 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:19 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:20 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Deleted volume successfully. Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-2f785c65-e0d9-4ddf-9c12-a86876721957 tempest-ProjectReaderTests-1423558856 None] Lock "cinder-b762b047-b7c0-4161-9809-afe33e3c5fdc-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:20 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:20 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD Nov 02 12:56:20 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:20 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD' failed. Not Retrying. {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] 6bfff7cc-529c-4b6a-9790-c03327271ccc was raw, converting to qcow2 {{(pid=86731) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Nov 02 12:56:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:20 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 Nov 02 12:56:20 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:21 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13" returned: 0 in 0.568s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6bfff7cc-529c-4b6a-9790-c03327271ccc_yrixzn6udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:56:21 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:21 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1G Nov 02 12:56:21 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:21 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 1G" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Downloaded image 6bfff7cc-529c-4b6a-9790-c03327271ccc ((None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}])) to volume a5e853cf-daeb-471f-a58e-9b3aaf950f13 successfully. {{(pid=86731) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1237}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Temporary image 6bfff7cc-529c-4b6a-9790-c03327271ccc for user 30bdbfffd5af496eb4fefa30bb866520 is deleted. {{(pid=86731) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.volume_utils [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Marking volume a5e853cf-daeb-471f-a58e-9b3aaf950f13 as bootable. {{(pid=86731) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1141}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Copying metadata from image 6bfff7cc-529c-4b6a-9790-c03327271ccc to a5e853cf-daeb-471f-a58e-9b3aaf950f13. {{(pid=86731) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Creating volume glance metadata for volume a5e853cf-daeb-471f-a58e-9b3aaf950f13 backed by image 6bfff7cc-529c-4b6a-9790-c03327271ccc with: {'image_id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4d09903250b2942668d79bef7e2ac035', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86731) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8dcd1a-fbbf-4bb4-923e-2a46ee7a76b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13', 'volume_size': 1, 'image_id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6bfff7cc-529c-4b6a-9790-c03327271ccc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d09903250b2942668d79bef7e2ac035', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '790e3ca9b6d2443380d49ceb78145aab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49cf421fe3b753afa54230ac91fceb79585b3d39fc32c5c23eff9c580e8c8dbf7cc1d89c8a6bcf2112bdaa96dc72816d28154170d49ca9f20ccf2ffdde502c9c', 'id': '6bfff7cc-529c-4b6a-9790-c03327271ccc', 'created_at': datetime.datetime(2026, 11, 2, 11, 56, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 56, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6bfff7cc-529c-4b6a-9790-c03327271ccc/file', 'properties': {}}, 'image_service': }' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b16a43-fade-4035-8c49-dc6eeb3e9ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:21 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Volume volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 (a5e853cf-daeb-471f-a58e-9b3aaf950f13): created successfully Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b16a43-fade-4035-8c49-dc6eeb3e9ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Flow 'volume_create_manager' (49582f65-2bc5-4ea4-9c15-1619e6d5bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:21 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3aeaaffe-7aaf-427b-b839-52d8a7b4bc0c tempest-VolumeImageDependencyTests-310128962 None] Created volume successfully. Nov 02 12:56:21 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Acquiring lock "cinder-a5e853cf-daeb-471f-a58e-9b3aaf950f13-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "cinder-a5e853cf-daeb-471f-a58e-9b3aaf950f13-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Acquiring lock "cinder-quobyte-a5e853cf-daeb-471f-a58e-9b3aaf950f13" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "cinder-quobyte-a5e853cf-daeb-471f-a58e-9b3aaf950f13" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[42743021-0d16-4d14-99f5-88999f2424e6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:22 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 Nov 02 12:56:22 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:22 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13" returned: 0 in 0.404s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:22 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13 Nov 02 12:56:22 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:22 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-a5e853cf-daeb-471f-a58e-9b3aaf950f13" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "cinder-quobyte-a5e853cf-daeb-471f-a58e-9b3aaf950f13" released by "delete_volume" :: held 0.797s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:22 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Created reservations ['b1248609-661b-493f-a28d-b4628c2b4cd4', '0d4551cd-1118-4000-ac4a-acc0e92bc928', '2696506e-338f-4178-8345-9eabd4bd648f', '10bedef4-b31e-4b16-94b6-de178446a882'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:23 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:23 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:23 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.318s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Deleted volume successfully. Nov 02 12:56:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-3310b482-2dd7-4da6-b6b1-258014a6944a tempest-VolumeImageDependencyTests-310128962 None] Lock "cinder-a5e853cf-daeb-471f-a58e-9b3aaf950f13-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:29 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:29 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (91b35b43-c3b8-4b4f-b5fc-7054196b2438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4d3ec8-74fd-4472-8d2b-ce1b7d11cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:29 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.289s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4d3ec8-74fd-4472-8d2b-ce1b7d11cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376460574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f92f0-80c1-4be0-88cd-c57c8a80053a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:29Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8991a537-1e13-48c0-9907-3b71ff154325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8991a537-1e13-48c0-9907-3b71ff154325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94fb732-5d58-423f-b947-2b88cc87f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94fb732-5d58-423f-b947-2b88cc87f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383f92f0-80c1-4be0-88cd-c57c8a80053a', 'volume_name': 'volume-383f92f0-80c1-4be0-88cd-c57c8a80053a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d417b31-2104-46c5-8e72-2a31470187e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d417b31-2104-46c5-8e72-2a31470187e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bd8d1-ea58-41c7-901e-30dcfb99d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:29 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Volume 383f92f0-80c1-4be0-88cd-c57c8a80053a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383f92f0-80c1-4be0-88cd-c57c8a80053a', 'volume_size': 1} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376460574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383f92f0-80c1-4be0-88cd-c57c8a80053a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:29Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Creating volume 383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:29 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:56:29 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a 1073741824 Nov 02 12:56:29 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:29 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a 1073741824" returned: 0 in 0.579s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:30 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a Nov 02 12:56:30 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:30 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a" returned: 0 in 0.288s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bd8d1-ea58-41c7-901e-30dcfb99d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383f92f0-80c1-4be0-88cd-c57c8a80053a', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cba8fc-ff9f-48ed-a671-d7476997509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:30 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Volume volume-383f92f0-80c1-4be0-88cd-c57c8a80053a (383f92f0-80c1-4be0-88cd-c57c8a80053a): created successfully Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cba8fc-ff9f-48ed-a671-d7476997509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:30 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (91b35b43-c3b8-4b4f-b5fc-7054196b2438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-45758014-c20d-4f7f-99e6-ca8229edd5b2 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:56:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:31 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot 3e5520a1-d245-41b4-bddb-97cf283b450a of volume 383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:31 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a1b35a-0893-4dd2-afd9-d1f716ac1bfb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:31 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a Nov 02 12:56:31 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:32 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a" returned: 0 in 0.423s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:32 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a 1G Nov 02 12:56:32 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:32 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a 1G" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f92f0-80c1-4be0-88cd-c57c8a80053a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:32 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f92f0-80c1-4be0-88cd-c57c8a80053a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a Nov 02 12:56:32 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:33 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-383f92f0-80c1-4be0-88cd-c57c8a80053a -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a" returned: 0 in 0.344s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a is being set with open permissions: ugo+rw Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:33 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a Nov 02 12:56:33 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:33 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:33 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info Nov 02 12:56:33 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:33 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info" returned: 0 in 0.299s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:33 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info is being set with open permissions: ugo+rw Nov 02 12:56:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:33 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info Nov 02 12:56:33 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:34 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.info" returned: 0 in 0.351s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-df9af4f6-0326-45e5-bbfa-3c8e2be185bb tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-3e5520a1-d245-41b4-bddb-97cf283b450a-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-3e5520a1-d245-41b4-bddb-97cf283b450a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-3e5520a1-d245-41b4-bddb-97cf283b450a" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3e5520a1-d245-41b4-bddb-97cf283b450a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot 3e5520a1-d245-41b4-bddb-97cf283b450a of volume 383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386cb36-3b13-4456-a693-396e22accc3c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:35 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a Nov 02 12:56:35 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:35 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a" returned: 0 in 0.430s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-383f92f0-80c1-4be0-88cd-c57c8a80053a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[512b8c7e-1ec1-403a-9efd-bbad754048f9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:35 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a Nov 02 12:56:35 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:35 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a" returned: 0 in 0.442s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:35 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a Nov 02 12:56:35 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:36 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a" returned: 0 in 0.416s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:36 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a Nov 02 12:56:36 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:36 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a.3e5520a1-d245-41b4-bddb-97cf283b450a" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3e5520a1-d245-41b4-bddb-97cf283b450a" released by "_delete_snapshot" :: held 1.798s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" released by "delete_snapshot" :: held 1.824s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Created reservations ['4910d4e3-58b9-443d-a6f5-96e9bf16f3d9', '693b4d60-642d-4a56-862b-0e02096ab603', '2244dfa1-361c-420f-b096-051941b1c342', '17654bbe-0402-4e74-8d15-06ee6dac94d1'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:36 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:56:36 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b15b0e72-fefe-4175-bb3f-bddbd3998eb5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-3e5520a1-d245-41b4-bddb-97cf283b450a-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-383f92f0-80c1-4be0-88cd-c57c8a80053a-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "cinder-383f92f0-80c1-4be0-88cd-c57c8a80053a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" acquired by "delete_volume" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ce652-87fe-4b38-ac8e-457e288d4bdb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:37 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a Nov 02 12:56:37 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:37 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a" returned: 0 in 0.428s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:37 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a Nov 02 12:56:37 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:37 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-383f92f0-80c1-4be0-88cd-c57c8a80053a" returned: 0 in 0.286s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-383f92f0-80c1-4be0-88cd-c57c8a80053a" released by "delete_volume" :: held 0.797s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Created reservations ['88655de5-68a0-4a11-8d83-d461481a6fda', 'ba232dd7-fb8d-4277-8dd8-1072d0c3c182', '9467b7d5-1cc8-45c3-9924-83864dccabf9', '7725a36e-7d08-44c8-b1d4-f093e3189729'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:38 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:38 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:38 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.349s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-45263bf9-9ab9-4d0c-8f96-df3251382c3d tempest-ProjectMemberTests-1699670525 None] Lock "cinder-383f92f0-80c1-4be0-88cd-c57c8a80053a-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:38 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (554c9d54-7ae3-4485-9bbf-81a62d134f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe404a8b-e161-4895-88a2-3b22dac86ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe404a8b-e161-4895-88a2-3b22dac86ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159759481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a26ee3-76c0-4aa5-bf4b-ec896d3a372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:39Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6104295e-dc86-429c-bc88-5b91ffc1e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6104295e-dc86-429c-bc88-5b91ffc1e335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ef6e5f-3f8c-4087-9c57-be024e1a9727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1ef6e5f-3f8c-4087-9c57-be024e1a9727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a26ee3-76c0-4aa5-bf4b-ec896d3a372d', 'volume_name': 'volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fee866-690d-4251-b127-10a531ca1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fee866-690d-4251-b127-10a531ca1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd907da-33f3-4b2e-b588-524edc1dfa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:39 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Volume 46a26ee3-76c0-4aa5-bf4b-ec896d3a372d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d', 'volume_size': 1} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159759481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a26ee3-76c0-4aa5-bf4b-ec896d3a372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:39Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Creating volume 46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:39 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:39 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d 1073741824 Nov 02 12:56:39 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:39 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d 1073741824" returned: 0 in 0.752s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:39 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d Nov 02 12:56:39 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:40 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" returned: 0 in 0.313s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd907da-33f3-4b2e-b588-524edc1dfa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f262c54-92de-44ac-bca1-1a5355baee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Volume volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d (46a26ee3-76c0-4aa5-bf4b-ec896d3a372d): created successfully Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f262c54-92de-44ac-bca1-1a5355baee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (554c9d54-7ae3-4485-9bbf-81a62d134f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6e71c1a0-aeda-439a-8625-b4aa18fbc6c0 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Flow 'volume_create_manager' (b3cde8df-e2b9-46ab-9256-5b91cde635fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2421687-d702-4065-a0cb-ca3a212968cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2421687-d702-4065-a0cb-ca3a212968cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246132191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea009c-d286-46a9-a74e-09a2f87ce615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e604e4301e44430a91e9233bdc0e6f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:41Z,use_quota=True,user_id='abd7ca8865854afc94cef78e34293e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b19578f-bea3-477a-8e80-b7dafd5717b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b19578f-bea3-477a-8e80-b7dafd5717b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe69edc-eeb4-4e6b-833c-8c1340055f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe69edc-eeb4-4e6b-833c-8c1340055f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ea009c-d286-46a9-a74e-09a2f87ce615', 'volume_name': 'volume-03ea009c-d286-46a9-a74e-09a2f87ce615', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080d3c0b-4318-4240-a04e-56b6f55a40b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080d3c0b-4318-4240-a04e-56b6f55a40b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59704c7-c3be-4418-b594-0cedae0ae529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:40 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Volume 03ea009c-d286-46a9-a74e-09a2f87ce615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ea009c-d286-46a9-a74e-09a2f87ce615', 'volume_size': 1} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1246132191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ea009c-d286-46a9-a74e-09a2f87ce615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e604e4301e44430a91e9233bdc0e6f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:41Z,use_quota=True,user_id='abd7ca8865854afc94cef78e34293e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Creating volume 03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:40 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:40 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 1073741824 Nov 02 12:56:40 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:41 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 1073741824" returned: 0 in 0.537s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:41 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:41 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:41 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.419s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59704c7-c3be-4418-b594-0cedae0ae529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ea009c-d286-46a9-a74e-09a2f87ce615', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47025c74-63ed-4444-b6db-18a6254aeeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 of volume 46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Volume volume-03ea009c-d286-46a9-a74e-09a2f87ce615 (03ea009c-d286-46a9-a74e-09a2f87ce615): created successfully Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47025c74-63ed-4444-b6db-18a6254aeeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Flow 'volume_create_manager' (b3cde8df-e2b9-46ab-9256-5b91cde635fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[558478aa-e93c-4c5f-891c-8d5a9e0e28de]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:41 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-20ecdf68-c551-4413-8c86-14c4018bf4d7 tempest-SnapshotDependencyTests-730638611 None] Created volume successfully. Nov 02 12:56:41 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d Nov 02 12:56:41 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:42 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" returned: 0 in 0.389s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:42 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 1G Nov 02 12:56:42 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:42 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 1G" returned: 0 in 0.427s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:42 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 Nov 02 12:56:42 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:42 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" returned: 0 in 0.308s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:42 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 is being set with open permissions: ugo+rw Nov 02 12:56:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:42 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 Nov 02 12:56:42 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:43 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:43 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info Nov 02 12:56:43 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:43 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info" returned: 0 in 0.264s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info is being set with open permissions: ugo+rw Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:43 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info Nov 02 12:56:43 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:43 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.info" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.630s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Creating offline snapshot d5180d9c-61ee-4be2-ac9e-d2476bee9e7d of volume 03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:43 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-3a8ea979-9e7b-4c00-aceb-8fa04a4a0bf4 tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[76094eaf-4866-4b10-a7ce-15967b10565c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:43 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:43 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:44 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.393s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:44 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d 1G Nov 02 12:56:44 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 of volume 46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b1106-aec8-4caa-9c1f-81cec7afc2ee]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:44 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 Nov 02 12:56:44 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:44 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d 1G" returned: 0 in 0.535s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ea009c-d286-46a9-a74e-09a2f87ce615 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:44 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ea009c-d286-46a9-a74e-09a2f87ce615 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:44 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:44 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d0c61-a51b-4697-9fff-c9dd2beda2a2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:44 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ea009c-d286-46a9-a74e-09a2f87ce615 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.322s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:44 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d is being set with open permissions: ugo+rw Nov 02 12:56:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:44 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:44 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d Nov 02 12:56:45 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.260s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:45 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info Nov 02 12:56:45 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" returned: 0 in 0.433s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:45 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 Nov 02 12:56:45 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info" returned: 0 in 0.272s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:45 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info is being set with open permissions: ugo+rw Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:45 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info Nov 02 12:56:45 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" returned: 0 in 0.402s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:45 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9 Nov 02 12:56:45 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:45 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.info" returned: 0 in 0.294s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:45 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-209a32df-b436-4426-a28f-3649a264746a tempest-SnapshotDependencyTests-730638611 None] Create snapshot completed successfully Nov 02 12:56:45 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d.fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9" released by "_delete_snapshot" :: held 1.667s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" released by "delete_snapshot" :: held 1.692s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Created reservations ['906bc9f7-113e-4ecf-b3c0-faf3ea20dbf2', '403378c5-1796-42d5-a2e2-45045c5c833e', 'e65c3cce-babd-40da-9d4f-422e8aab7a9a', '4e443c3b-f038-4972-ac4b-cb00d293c331'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7fb9a511-56b6-4bb5-afc5-28b44f158eda tempest-ProjectMemberTests-1699670525 None] Lock "cinder-fb1d89b6-ac93-433f-a18f-dc9b8cfedcb9-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "cinder-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b9598-01c6-4e20-8e84-211e712b207b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:46 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d Nov 02 12:56:46 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Flow 'volume_create_manager' (557bf70d-7239-4c67-9357-bd86e9f768e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51569492-88a4-4ff1-881b-bae610e49375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51569492-88a4-4ff1-881b-bae610e49375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028c8424-bc36-4eaa-8b10-26b8ec48dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e604e4301e44430a91e9233bdc0e6f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5180d9c-61ee-4be2-ac9e-d2476bee9e7d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:47Z,use_quota=True,user_id='abd7ca8865854afc94cef78e34293e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c925b1-682e-402c-906f-e1b428351dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c925b1-682e-402c-906f-e1b428351dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e61e4e-bac1-4339-aeff-5d09fa23319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:46 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e61e4e-bac1-4339-aeff-5d09fa23319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '028c8424-bc36-4eaa-8b10-26b8ec48dfed', 'volume_name': 'volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed', 'volume_size': 1, 'snapshot_id': 'd5180d9c-61ee-4be2-ac9e-d2476bee9e7d'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3c2d48-415a-40b6-ba42-ff800d7e8981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3c2d48-415a-40b6-ba42-ff800d7e8981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0417f0-40e4-4379-82b1-5de68e855697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:47 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Volume 028c8424-bc36-4eaa-8b10-26b8ec48dfed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed', 'volume_size': 1, 'snapshot_id': 'd5180d9c-61ee-4be2-ac9e-d2476bee9e7d'} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-028c8424-bc36-4eaa-8b10-26b8ec48dfed" by "_create_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-028c8424-bc36-4eaa-8b10-26b8ec48dfed" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Creating volume 028c8424-bc36-4eaa-8b10-26b8ec48dfed from snapshot d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" by "_copy_volume_from_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] snapshot: d5180d9c-61ee-4be2-ac9e-d2476bee9e7d, volume: 028c8424-bc36-4eaa-8b10-26b8ec48dfed, {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c943b8-0fd7-4cae-9686-0610f0e02da7]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:47 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" returned: 0 in 0.438s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:47 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d Nov 02 12:56:47 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:47 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:47 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:47 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" returned: 0 in 0.279s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d" released by "delete_volume" :: held 0.825s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Created reservations ['ade1eb83-dc6a-450d-8c86-56ff5032dc35', 'f8df58d5-64f5-408c-9022-7292d4a097a1', '7cdda5ae-c591-44bd-8e90-f00a75d18f83', 'dedd77f3-89d5-431a-8f53-0699743ae5a4'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:47 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ea009c-d286-46a9-a74e-09a2f87ce615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1fe31e-154c-4709-beb1-a3a006f9eae9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:47 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:47 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:47 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:47 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:48 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:48 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:56:48 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.490s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Creating direct copy from snapshot {{(pid=86731) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.utils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Path /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed not found in is_blk_device check {{(pid=86731) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-31562b7b-91a3-4752-bc32-25235ce9896f tempest-ProjectMemberTests-1699670525 None] Lock "cinder-46a26ee3-76c0-4aa5-bf4b-ec896d3a372d-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:48 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed Nov 02 12:56:48 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (b3c6415f-6897-4522-bf6c-56953ee28141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde5e6d9-706e-4aee-9976-a7f87c3a76e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde5e6d9-706e-4aee-9976-a7f87c3a76e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066128868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05f0bf1-50ff-4ff4-9982-94b10b61fdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:48Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77ef80d-76b6-4299-be42-201341c72dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77ef80d-76b6-4299-be42-201341c72dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78c7452-061b-4463-9f8e-1c6e0b73bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78c7452-061b-4463-9f8e-1c6e0b73bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05f0bf1-50ff-4ff4-9982-94b10b61fdba', 'volume_name': 'volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce718163-68ae-4f4d-8b73-a57ce30016f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce718163-68ae-4f4d-8b73-a57ce30016f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02696509-1cf1-40af-91da-db28678ff94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:48 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Volume e05f0bf1-50ff-4ff4-9982-94b10b61fdba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba', 'volume_size': 1} Nov 02 12:56:48 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (cb296384-1b7e-46f4-9f05-78186c56144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354f8bcb-0cb0-471c-b0c0-1ef2cdd19758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354f8bcb-0cb0-471c-b0c0-1ef2cdd19758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475892632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a73c10-cb74-4b88-80f8-7da1838973c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:50Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27316dc-c597-43a5-acbe-97e062dfba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27316dc-c597-43a5-acbe-97e062dfba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ca3de3-ce81-4a5c-bd93-ee4ab1e76858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ca3de3-ce81-4a5c-bd93-ee4ab1e76858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a73c10-cb74-4b88-80f8-7da1838973c8', 'volume_name': 'volume-e1a73c10-cb74-4b88-80f8-7da1838973c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8636f88b-8a38-4e4f-a55f-a2e787871d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8636f88b-8a38-4e4f-a55f-a2e787871d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efbf73f-fa38-43d3-9fc2-d8ca92b85336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:49 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Volume e1a73c10-cb74-4b88-80f8-7da1838973c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a73c10-cb74-4b88-80f8-7da1838973c8', 'volume_size': 1} Nov 02 12:56:49 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:54 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed" returned: 0 in 6.481s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.image.image_utils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Image conversion details: src /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed {{(pid=86731) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:564}} Nov 02 12:56:54 devstack cinder-volume[86731]: INFO cinder.image.image_utils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Converted 1024.00 MB image at 157.96 MB/s Nov 02 12:56:54 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed is being set with open permissions: ugo+rw Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:54 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed Nov 02 12:56:54 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:54 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" released by "_copy_volume_from_snapshot" :: held 7.739s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-028c8424-bc36-4eaa-8b10-26b8ec48dfed" released by "_create_volume_from_snapshot" :: held 7.817s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.836s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.436s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066128868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05f0bf1-50ff-4ff4-9982-94b10b61fdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:48Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Creating volume e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:54 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:54 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba 1073741824 Nov 02 12:56:54 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0417f0-40e4-4379-82b1-5de68e855697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed', 'volume_size': 1, 'snapshot_id': 'd5180d9c-61ee-4be2-ac9e-d2476bee9e7d'}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d7b9b5-b2da-4570-b479-ef14901f7982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:54 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Volume volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed (028c8424-bc36-4eaa-8b10-26b8ec48dfed): created successfully Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d7b9b5-b2da-4570-b479-ef14901f7982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:54 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Flow 'volume_create_manager' (557bf70d-7239-4c67-9357-bd86e9f768e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:54 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-026a5563-5f14-4731-9404-2892ccd08c02 tempest-SnapshotDependencyTests-730638611 None] Created volume successfully. Nov 02 12:56:55 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba 1073741824" returned: 0 in 0.464s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:55 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba Nov 02 12:56:55 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:55 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" returned: 0 in 0.276s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.736s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475892632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a73c10-cb74-4b88-80f8-7da1838973c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:50Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Creating volume e1a73c10-cb74-4b88-80f8-7da1838973c8 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:55 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:55 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 1073741824 Nov 02 12:56:55 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02696509-1cf1-40af-91da-db28678ff94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c796ec4-4bc2-4b16-ba99-7795940ad779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:55 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Volume volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba (e05f0bf1-50ff-4ff4-9982-94b10b61fdba): created successfully Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c796ec4-4bc2-4b16-ba99-7795940ad779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (b3c6415f-6897-4522-bf6c-56953ee28141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:55 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c05b0995-0930-4821-acdb-34b0b332b540 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Deleting offline snapshot d5180d9c-61ee-4be2-ac9e-d2476bee9e7d of volume 03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] snapshot_file for this snap is: volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a678c720-3e21-4202-95b5-62606aebd0be]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:55 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:55 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:55 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:56 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 1073741824" returned: 0 in 0.518s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:56 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 Nov 02 12:56:56 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:56 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.424s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ea009c-d286-46a9-a74e-09a2f87ce615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ccf39-c71d-4227-b0d6-9f7cb450836b]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:56 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:56 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:56 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8" returned: 0 in 0.253s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.332s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efbf73f-fa38-43d3-9fc2-d8ca92b85336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a73c10-cb74-4b88-80f8-7da1838973c8', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5c2dfd-42d4-4ada-a4cc-116115398b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot e07458f9-37fd-4521-abc0-632c40b6cbc0 of volume e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:56:56 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Volume volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 (e1a73c10-cb74-4b88-80f8-7da1838973c8): created successfully Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5c2dfd-42d4-4ada-a4cc-116115398b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (cb296384-1b7e-46f4-9f05-78186c56144d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf6454-37b3-4672-86ab-9ba0aee0a4aa]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:56 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f261ae07-520d-4e00-b29f-f02d3b455b3b tempest-ProjectReaderTests-1911854889 None] Created volume successfully. Nov 02 12:56:56 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba Nov 02 12:56:56 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:56 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.558s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:56 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:56 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:56 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:56 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:56 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 1G Nov 02 12:56:56 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:57 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.363s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:57 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d Nov 02 12:56:57 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:57 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 1G" returned: 0 in 0.419s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:57 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 Nov 02 12:56:57 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:57 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615.d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d" released by "_delete_snapshot" :: held 1.761s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" released by "delete_snapshot" :: held 1.788s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-e1a73c10-cb74-4b88-80f8-7da1838973c8-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Created reservations ['134e1e3e-c14b-46e7-975c-90bdaff8b965', 'db94be2e-96dc-4388-872f-04bccc1cff45', '8fe1e876-9473-445b-a7ee-844cd78fc1dc', '085e31da-38d5-4e8d-b796-fe36ab2d45dd'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-e1a73c10-cb74-4b88-80f8-7da1838973c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:57 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-quobyte-e1a73c10-cb74-4b88-80f8-7da1838973c8" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0" returned: 0 in 0.399s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:57 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 is being set with open permissions: ugo+rw Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:57 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 Nov 02 12:56:57 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-e1a73c10-cb74-4b88-80f8-7da1838973c8" acquired by "delete_volume" :: waited 0.039s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:57 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Delete snapshot completed successfully. Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-d2bd4fb1-d9b7-4a08-9af9-022d092577fb tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-d5180d9c-61ee-4be2-ac9e-d2476bee9e7d-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f91724-5673-4a00-9fd4-f05286270386]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-03ea009c-d286-46a9-a74e-09a2f87ce615-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-03ea009c-d286-46a9-a74e-09a2f87ce615-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:57 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 Nov 02 12:56:57 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:57 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" acquired by "delete_volume" :: waited 0.021s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115c6d2-7d2b-4361-ab39-05180fddd14d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:58 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0" returned: 0 in 0.307s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info Nov 02 12:56:58 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:58 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8 Nov 02 12:56:58 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info is being set with open permissions: ugo+rw Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info Nov 02 12:56:58 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.397s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615 Nov 02 12:56:58 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e1a73c10-cb74-4b88-80f8-7da1838973c8" returned: 0 in 0.273s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-e1a73c10-cb74-4b88-80f8-7da1838973c8" released by "delete_volume" :: held 0.772s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Created reservations ['cf8ccd52-41f1-4bfc-970c-e60f219c0f2e', 'bfe7766c-7600-418f-b4e4-bfc49685e294', '113f1eb5-737b-4954-b842-a9139c775f50', 'e2acc75f-00e8-4ce6-a658-7c56df4f2478'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:58 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.info" returned: 0 in 0.271s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:58 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-03ea009c-d286-46a9-a74e-09a2f87ce615" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:58 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:58 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:58 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c5a28d2c-dd74-408d-882c-368a65362c18 tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-03ea009c-d286-46a9-a74e-09a2f87ce615" released by "delete_volume" :: held 0.762s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Created reservations ['2d26899e-41d2-4569-8203-923349aef7a9', 'b53d57ac-b7bf-4d7d-a87b-88e07ca59896', 'e87b14af-92b7-409a-89aa-e803152d02f1', 'e58160f7-ea38-4661-aa9f-8a2adc95a57d'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:58 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:58 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:56:58 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:59 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Deleted volume successfully. Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-693f0f80-cc75-4ba0-b078-9db865807967 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-e1a73c10-cb74-4b88-80f8-7da1838973c8-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-028c8424-bc36-4eaa-8b10-26b8ec48dfed-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-028c8424-bc36-4eaa-8b10-26b8ec48dfed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:59 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.362s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:59 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Deleted volume successfully. Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" acquired by "delete_volume" :: waited 0.024s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ebde1de9-2af5-4ee5-aa45-f47c897f815d tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-03ea009c-d286-46a9-a74e-09a2f87ce615-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[92914293-6ce4-4af9-8506-4faea5ce9e06]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-e07458f9-37fd-4521-abc0-632c40b6cbc0-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-e07458f9-37fd-4521-abc0-632c40b6cbc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (ff9c810b-840b-4ec7-a585-9c1821b9c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1099549-bab3-48bc-a1b3-bf04d01c9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-e07458f9-37fd-4521-abc0-632c40b6cbc0" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1099549-bab3-48bc-a1b3-bf04d01c9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122301909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a10d69-138f-43b5-99cb-ec342f4f5b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:59Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:59 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed Nov 02 12:56:59 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126c883-7b74-4607-a31d-b625ea27bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8126c883-7b74-4607-a31d-b625ea27bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c536bd-c32d-405f-8678-a64913b6d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c536bd-c32d-405f-8678-a64913b6d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a10d69-138f-43b5-99cb-ec342f4f5b6e', 'volume_name': 'volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26230996-673a-4b2e-9d89-22b3eaec326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26230996-673a-4b2e-9d89-22b3eaec326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238668ca-6af0-4646-9098-c83cecb768d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:56:59 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Volume 19a10d69-138f-43b5-99cb-ec342f4f5b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e', 'volume_size': 1} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-122301909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a10d69-138f-43b5-99cb-ec342f4f5b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:56:59Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Creating volume 19a10d69-138f-43b5-99cb-ec342f4f5b6e {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:56:59 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e07458f9-37fd-4521-abc0-632c40b6cbc0" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot e07458f9-37fd-4521-abc0-632c40b6cbc0 of volume e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:56:59 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e 1073741824 Nov 02 12:56:59 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f3a5d0-a3e2-4259-918c-d365ddb0e0f4]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:59 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 Nov 02 12:56:59 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:59 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed" returned: 0 in 0.414s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:56:59 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed Nov 02 12:56:59 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:56:59 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 02 12:56:59 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e 1073741824" returned: 0 in 0.486s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0" returned: 0 in 0.447s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:00 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c71b8-4e79-405f-97ba-07a7e5c7a7f2]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-028c8424-bc36-4eaa-8b10-26b8ec48dfed" returned: 0 in 0.325s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e Nov 02 12:57:00 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-quobyte-028c8424-bc36-4eaa-8b10-26b8ec48dfed" released by "delete_volume" :: held 0.805s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Created reservations ['98f8cb52-38ee-4e6a-bfdc-f5e17bb9224e', 'efe24467-5999-4d1f-818e-39ead01d3fad', 'a53babe4-df85-49a5-9c77-d2add345df50', '891cfdee-ee87-4d06-bd8f-822d35491824'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:00 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba Nov 02 12:57:00 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:00 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:00 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:00 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e" returned: 0 in 0.374s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238668ca-6af0-4646-9098-c83cecb768d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abca9f7-9023-4dfd-89a4-45f550a3efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:00 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Volume volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e (19a10d69-138f-43b5-99cb-ec342f4f5b6e): created successfully Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abca9f7-9023-4dfd-89a4-45f550a3efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (ff9c810b-840b-4ec7-a585-9c1821b9c628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-be7fa91e-4e56-4dfa-b36d-883769c748c3 tempest-ProjectReaderTests-1911854889 None] Created volume successfully. Nov 02 12:57:00 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" returned: 0 in 0.539s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:00 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 Nov 02 12:57:00 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:00 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.435s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:00 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Deleted volume successfully. Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-ce5c7b0c-5607-4cb9-9dac-6eaa3e31dab7 tempest-SnapshotDependencyTests-730638611 None] Lock "cinder-028c8424-bc36-4eaa-8b10-26b8ec48dfed-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:00 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0" returned: 0 in 0.376s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:00 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:01 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0 Nov 02 12:57:01 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:01 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba.e07458f9-37fd-4521-abc0-632c40b6cbc0" returned: 0 in 0.258s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e07458f9-37fd-4521-abc0-632c40b6cbc0" released by "_delete_snapshot" :: held 1.745s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" released by "delete_snapshot" :: held 1.832s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Created reservations ['e99934a4-b7b3-44a6-a136-cae209cb0e88', 'b6395f6e-4431-4b53-b08a-45cbb0e89006', 'aff5e731-c550-4535-81e4-b7deebc4bbad', '13d3287a-1f3c-4a4f-9ffe-e71689207a1f'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:01 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-88eaa12f-9c90-4baf-adb0-b26c6d7932b2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-e07458f9-37fd-4521-abc0-632c40b6cbc0-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-19a10d69-138f-43b5-99cb-ec342f4f5b6e-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-19a10d69-138f-43b5-99cb-ec342f4f5b6e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-e05f0bf1-50ff-4ff4-9982-94b10b61fdba-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-e05f0bf1-50ff-4ff4-9982-94b10b61fdba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-quobyte-19a10d69-138f-43b5-99cb-ec342f4f5b6e" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-19a10d69-138f-43b5-99cb-ec342f4f5b6e" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ede94-f1f7-4427-b850-9875a392c730]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" acquired by "delete_volume" :: waited 0.038s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[44761d89-adcd-403e-a2b5-cdb71f27922c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:01 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:01 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e Nov 02 12:57:01 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:01 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba Nov 02 12:57:01 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:02 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e" returned: 0 in 0.463s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:02 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e Nov 02 12:57:02 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:02 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:02 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba Nov 02 12:57:02 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:02 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-19a10d69-138f-43b5-99cb-ec342f4f5b6e" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-19a10d69-138f-43b5-99cb-ec342f4f5b6e" released by "delete_volume" :: held 0.817s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Created reservations ['6a1e0c38-c8cb-4def-95b3-7ddae3fea4e5', 'a1300ca4-be84-4639-9ff0-b34ea8f86d26', 'eb9d5d41-5f6c-4040-a0c6-26aec5831b1b', '15c3a56a-ffee-4ab4-b271-bd572684a839'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:02 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-e05f0bf1-50ff-4ff4-9982-94b10b61fdba" released by "delete_volume" :: held 0.843s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Created reservations ['b1708913-4109-4da9-b76a-e2f787c0e48d', '8992a643-671f-442f-af82-f89687aa4289', '86742619-564f-4729-a24a-6bdcfbe2ec49', '2bb21705-e05d-40dd-b220-20d26671d5a5'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:02 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:02 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:02 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:02 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:02 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:03 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.364s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Deleted volume successfully. Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7aa255fc-5768-4d1c-aadb-5d76f29e2af8 tempest-ProjectReaderTests-1911854889 None] Lock "cinder-19a10d69-138f-43b5-99cb-ec342f4f5b6e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:03 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:03 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-7597b409-ee1e-4f25-967b-e989c32236a2 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-e05f0bf1-50ff-4ff4-9982-94b10b61fdba-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (bc74add9-3526-46de-b23b-8ba3f2853c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7158d0c-a3d5-4264-9a39-66c7b96e06ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7158d0c-a3d5-4264-9a39-66c7b96e06ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1586101338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5c0c70-6114-4f8b-afe6-3ad106be960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:03Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fae43bb-8579-47e1-ba4d-9b634451a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fae43bb-8579-47e1-ba4d-9b634451a01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f12caf-d98e-47ee-ac5c-79fdfa9a4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f12caf-d98e-47ee-ac5c-79fdfa9a4f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5c0c70-6114-4f8b-afe6-3ad106be960b', 'volume_name': 'volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccd5b6e-0afa-405c-9762-08fb3efe1542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccd5b6e-0afa-405c-9762-08fb3efe1542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09baa660-7d5f-411e-bf11-3ca9ac80162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:03 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Volume 4e5c0c70-6114-4f8b-afe6-3ad106be960b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b', 'volume_size': 1} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1586101338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5c0c70-6114-4f8b-afe6-3ad106be960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:03Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Creating volume 4e5c0c70-6114-4f8b-afe6-3ad106be960b {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:03 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:03 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b 1073741824 Nov 02 12:57:03 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:03 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b 1073741824" returned: 0 in 0.448s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:03 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:04 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b Nov 02 12:57:04 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:04 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b" returned: 0 in 0.282s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09baa660-7d5f-411e-bf11-3ca9ac80162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f43ae34-8a5e-44b3-8c0f-f8eabcf488aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Volume volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b (4e5c0c70-6114-4f8b-afe6-3ad106be960b): created successfully Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f43ae34-8a5e-44b3-8c0f-f8eabcf488aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (bc74add9-3526-46de-b23b-8ba3f2853c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:04 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-35ec65f1-a70f-4888-ad28-72e5bf7071fd tempest-ProjectReaderTests-1911854889 None] Created volume successfully. Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c95e055a-f5e0-4330-95ed-281a9f3a84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7880bb-8851-414b-a523-9eef3dbc5b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7880bb-8851-414b-a523-9eef3dbc5b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483836474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeb5976-5647-49ff-9b91-503141a6e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:04Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6748fe6b-b04c-42e0-a383-4e7b919443f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6748fe6b-b04c-42e0-a383-4e7b919443f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779f8163-e7bd-452e-8bef-2be3c86671b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779f8163-e7bd-452e-8bef-2be3c86671b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efeb5976-5647-49ff-9b91-503141a6e9da', 'volume_name': 'volume-efeb5976-5647-49ff-9b91-503141a6e9da', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff7e045-c247-43fe-8b1a-8a972807ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff7e045-c247-43fe-8b1a-8a972807ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f7ae19-9aec-41d9-bb34-5feb2d8840ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:04 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Volume efeb5976-5647-49ff-9b91-503141a6e9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efeb5976-5647-49ff-9b91-503141a6e9da', 'volume_size': 1} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483836474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeb5976-5647-49ff-9b91-503141a6e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:04Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Creating volume efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:04 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:04 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:04 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da 1073741824 Nov 02 12:57:04 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:05 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da 1073741824" returned: 0 in 0.467s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:05 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da Nov 02 12:57:05 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:05 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da" returned: 0 in 0.320s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f7ae19-9aec-41d9-bb34-5feb2d8840ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efeb5976-5647-49ff-9b91-503141a6e9da', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e94c4-2f37-4c6e-a6d1-e54996041e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:05 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Volume volume-efeb5976-5647-49ff-9b91-503141a6e9da (efeb5976-5647-49ff-9b91-503141a6e9da): created successfully Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e94c4-2f37-4c6e-a6d1-e54996041e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c95e055a-f5e0-4330-95ed-281a9f3a84b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:05 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1f5989f3-bbe5-4b2a-be98-777ad0d83da3 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-4e5c0c70-6114-4f8b-afe6-3ad106be960b-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "cinder-4e5c0c70-6114-4f8b-afe6-3ad106be960b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-quobyte-4e5c0c70-6114-4f8b-afe6-3ad106be960b" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-4e5c0c70-6114-4f8b-afe6-3ad106be960b" acquired by "delete_volume" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[99854322-7b00-4411-93b0-72bce73bff14]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:05 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b Nov 02 12:57:05 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot fde7d7dc-310a-4d69-8796-79436d22186d of volume efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910bdf4-1fea-428b-8df7-cec681f7cc70]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:05 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:06 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da Nov 02 12:57:06 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:06 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b" returned: 0 in 0.421s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:06 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b Nov 02 12:57:06 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:06 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da" returned: 0 in 0.462s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:06 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d 1G Nov 02 12:57:06 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:06 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-4e5c0c70-6114-4f8b-afe6-3ad106be960b" returned: 0 in 0.297s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-4e5c0c70-6114-4f8b-afe6-3ad106be960b" released by "delete_volume" :: held 0.776s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Created reservations ['071e3dca-b31a-41ce-9508-74d494440715', '423b7b92-74e0-49df-8c2a-d4c56c0f34d5', '0f178ed3-1292-4c3d-ac84-1169d4f19d0b', '90ce227b-7699-460b-bea6-a28f68ab1e61'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:06 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:06 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:06 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d 1G" returned: 0 in 0.474s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efeb5976-5647-49ff-9b91-503141a6e9da -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:06 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efeb5976-5647-49ff-9b91-503141a6e9da -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d Nov 02 12:57:06 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:06 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.336s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:06 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:07 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Deleted volume successfully. Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f9f0779b-40ba-4b14-b64f-b601e89e1c9a tempest-ProjectReaderTests-1911854889 None] Lock "cinder-4e5c0c70-6114-4f8b-afe6-3ad106be960b-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:07 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efeb5976-5647-49ff-9b91-503141a6e9da -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d" returned: 0 in 0.445s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d is being set with open permissions: ugo+rw Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:07 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d Nov 02 12:57:07 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (f525dc67-2ebc-4ad2-a87d-9bfcc4248d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7bd0cb-d779-41eb-b65f-cf5637fa1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7bd0cb-d779-41eb-b65f-cf5637fa1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419065078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1e178a-b81d-4153-b4cf-6f298845da99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:07Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5654a5ba-aa8a-4a88-a05f-5a2f14c5355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5654a5ba-aa8a-4a88-a05f-5a2f14c5355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31ce5a6-9631-414d-8912-33090f37a06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31ce5a6-9631-414d-8912-33090f37a06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1e178a-b81d-4153-b4cf-6f298845da99', 'volume_name': 'volume-7f1e178a-b81d-4153-b4cf-6f298845da99', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8592086f-9952-4d2a-b304-3e92fe4e0308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8592086f-9952-4d2a-b304-3e92fe4e0308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b910016-6611-4fd8-93db-c753011b7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:07 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Volume 7f1e178a-b81d-4153-b4cf-6f298845da99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1e178a-b81d-4153-b4cf-6f298845da99', 'volume_size': 1} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:07 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=150,cinder:INSERT=64,cinder:UPDATE=193,cinder:DELETE=16 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=151,cinder:INSERT=46,cinder:UPDATE=204,cinder:DELETE=16 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:07 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info Nov 02 12:57:07 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:07 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info" returned: 0 in 0.267s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:07 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info is being set with open permissions: ugo+rw Nov 02 12:57:07 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:07 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info Nov 02 12:57:07 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:08 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.info" returned: 0 in 0.269s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419065078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1e178a-b81d-4153-b4cf-6f298845da99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a16fba98861456f8d5b5fafd22dc49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:07Z,use_quota=True,user_id='d87b452b8ef04d18bb96bcf41aaf0e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Creating volume 7f1e178a-b81d-4153-b4cf-6f298845da99 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:08 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:08 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 1073741824 Nov 02 12:57:08 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:08 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-ae4dc8b9-dbc8-4557-b1ff-db9a1ab68ac1 tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:08 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 1073741824" returned: 0 in 0.471s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:08 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 Nov 02 12:57:08 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:08 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:08 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b910016-6611-4fd8-93db-c753011b7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1e178a-b81d-4153-b4cf-6f298845da99', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dfe5c8-5155-4465-bbdc-5221d4bba7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:09 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Volume volume-7f1e178a-b81d-4153-b4cf-6f298845da99 (7f1e178a-b81d-4153-b4cf-6f298845da99): created successfully Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dfe5c8-5155-4465-bbdc-5221d4bba7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Flow 'volume_create_manager' (f525dc67-2ebc-4ad2-a87d-9bfcc4248d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:09 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-2e4318e8-8352-4031-924c-1282163a9705 tempest-ProjectReaderTests-1911854889 None] Created volume successfully. Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-fde7d7dc-310a-4d69-8796-79436d22186d-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-fde7d7dc-310a-4d69-8796-79436d22186d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-fde7d7dc-310a-4d69-8796-79436d22186d" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-fde7d7dc-310a-4d69-8796-79436d22186d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot fde7d7dc-310a-4d69-8796-79436d22186d of volume efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2e799b-b419-43e2-8577-123b80203c5e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:09 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d Nov 02 12:57:09 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-7f1e178a-b81d-4153-b4cf-6f298845da99-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "cinder-7f1e178a-b81d-4153-b4cf-6f298845da99-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Acquiring lock "cinder-quobyte-7f1e178a-b81d-4153-b4cf-6f298845da99" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-7f1e178a-b81d-4153-b4cf-6f298845da99" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:09 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d" returned: 0 in 0.527s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efeb5976-5647-49ff-9b91-503141a6e9da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f111dafd-2683-474e-96f0-e0a05367f5c5]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c6305-8ee3-452f-bf2b-443e17d9a931]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:09 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:09 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 Nov 02 12:57:09 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:09 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da Nov 02 12:57:09 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:10 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99" returned: 0 in 0.420s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:10 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da" returned: 0 in 0.429s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:10 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99 Nov 02 12:57:10 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:10 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d Nov 02 12:57:10 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:10 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7f1e178a-b81d-4153-b4cf-6f298845da99" returned: 0 in 0.304s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "cinder-quobyte-7f1e178a-b81d-4153-b4cf-6f298845da99" released by "delete_volume" :: held 0.795s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Created reservations ['e37377ce-0894-4caa-80a4-e8f0bbee434f', 'cb764fe5-b12a-448c-bf3b-8beec4a71502', '2e6ad48a-a334-4117-8051-b516ad92c6d1', 'deaa80cb-aaa2-42f7-b503-05a6328af0bc'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:10 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d" returned: 0 in 0.456s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:10 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:10 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:10 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:10 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:10 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:11 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da.fde7d7dc-310a-4d69-8796-79436d22186d" returned: 0 in 0.305s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-fde7d7dc-310a-4d69-8796-79436d22186d" released by "_delete_snapshot" :: held 1.853s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" released by "delete_snapshot" :: held 1.882s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:11 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.332s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Deleted volume successfully. Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0a2b7b26-d5b3-4e40-bf0f-a88f06b7771f tempest-ProjectReaderTests-1911854889 None] Lock "cinder-7f1e178a-b81d-4153-b4cf-6f298845da99-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Created reservations ['96d88ccb-f1ab-4c04-9e62-eb916904b36e', '0633ea32-01bd-487d-a48c-1d4b02a9b489', 'cc395c32-e71b-4e76-887f-411abfb03ee9', '59cf8e0a-8dad-4d96-86c8-7b5340005225'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:11 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1deed20f-e011-40d2-8a02-2ff1446b22f1 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-fde7d7dc-310a-4d69-8796-79436d22186d-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-efeb5976-5647-49ff-9b91-503141a6e9da-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-efeb5976-5647-49ff-9b91-503141a6e9da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" acquired by "delete_volume" :: waited 0.023s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[67646d12-44ca-46d5-94bd-134a00b3fb0c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:11 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da Nov 02 12:57:11 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:11 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da" returned: 0 in 0.411s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:11 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:11 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da Nov 02 12:57:11 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:12 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-efeb5976-5647-49ff-9b91-503141a6e9da" returned: 0 in 0.265s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-efeb5976-5647-49ff-9b91-503141a6e9da" released by "delete_volume" :: held 0.766s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Created reservations ['5fe4d013-d166-46e8-9fe2-82d9f4ce2976', '58476a36-bc3e-48ad-bbdb-b4508e3e4640', '82b594e3-39b4-4309-ad1e-ee572230df7d', '6cb4e8a1-10f5-47f0-9abc-50bdc5dbf863'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:12 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:12 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:12 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.292s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:12 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:12 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-af36a873-fa48-4f3f-95d0-e7ba218ad6c5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-efeb5976-5647-49ff-9b91-503141a6e9da-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (606805e8-cd73-427b-b909-e9bc140fbe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4093766-7a11-42db-9d0d-194e54285bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4093766-7a11-42db-9d0d-194e54285bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716542584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a551f6-02a9-4df7-ba9f-15732a0e77a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:13Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d167a-01b7-4397-ab0e-0c6850908a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6d167a-01b7-4397-ab0e-0c6850908a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a961a2e6-4c40-4581-b6da-d89503fc3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a961a2e6-4c40-4581-b6da-d89503fc3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a551f6-02a9-4df7-ba9f-15732a0e77a6', 'volume_name': 'volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a6e39e-7eb4-41a0-a217-3a37445cd0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a6e39e-7eb4-41a0-a217-3a37445cd0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06387a0e-ae83-4ecb-8683-f06f75b14fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Volume 23a551f6-02a9-4df7-ba9f-15732a0e77a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6', 'volume_size': 1} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716542584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a551f6-02a9-4df7-ba9f-15732a0e77a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:13Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Creating volume 23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:13 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:13 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 1073741824 Nov 02 12:57:13 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:13 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 1073741824" returned: 0 in 0.409s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:13 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 Nov 02 12:57:13 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:13 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6" returned: 0 in 0.251s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06387a0e-ae83-4ecb-8683-f06f75b14fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff158ed-90da-49e4-a9b4-df3a251f117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:13 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Volume volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 (23a551f6-02a9-4df7-ba9f-15732a0e77a6): created successfully Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff158ed-90da-49e4-a9b4-df3a251f117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:13 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (606805e8-cd73-427b-b909-e9bc140fbe84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:13 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b95274b5-2a12-4965-aee7-c37c2f56b83b tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot 13568e07-6d83-4574-8ff8-93179e3e8105 of volume 23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb064d95-c55b-4a42-b69c-30ce6fcda9f9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:14 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 Nov 02 12:57:14 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:14 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6" returned: 0 in 0.352s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:14 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:14 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 1G Nov 02 12:57:14 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:15 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 1G" returned: 0 in 0.385s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:15 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 Nov 02 12:57:15 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:15 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 is being set with open permissions: ugo+rw Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:15 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 Nov 02 12:57:15 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:15 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:15 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info Nov 02 12:57:15 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:15 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info" returned: 0 in 0.249s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:15 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info is being set with open permissions: ugo+rw Nov 02 12:57:15 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:15 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info Nov 02 12:57:15 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:16 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.info" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:16 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-8ca0b556-33e4-40db-8dda-cd48a792d49b tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-13568e07-6d83-4574-8ff8-93179e3e8105-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-13568e07-6d83-4574-8ff8-93179e3e8105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-13568e07-6d83-4574-8ff8-93179e3e8105" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-13568e07-6d83-4574-8ff8-93179e3e8105" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot 13568e07-6d83-4574-8ff8-93179e3e8105 of volume 23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5e278-a3d1-4198-87b9-bcbfcf1c0c7c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:16 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 Nov 02 12:57:16 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:16 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e293729-fc39-4fde-8c48-7ba37e1b929d]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:16 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:16 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 Nov 02 12:57:16 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:17 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6" returned: 0 in 0.361s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:17 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 Nov 02 12:57:17 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:17 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105" returned: 0 in 0.326s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:17 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105 Nov 02 12:57:17 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:17 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6.13568e07-6d83-4574-8ff8-93179e3e8105" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-13568e07-6d83-4574-8ff8-93179e3e8105" released by "_delete_snapshot" :: held 1.377s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" released by "delete_snapshot" :: held 1.399s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Created reservations ['13a4ab7b-f23b-4128-b628-59fa11e8c9f7', '8748a390-9a1b-405f-bd7a-b45c0de10286', '3d8e453e-8428-4e9b-bfc8-c376b5244ec6', 'd8edb6b2-cc52-4a30-9f76-63d7d29fabac'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:17 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:17 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-85b0d3c3-7504-41ce-b647-0bc596ccd864 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-13568e07-6d83-4574-8ff8-93179e3e8105-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-23a551f6-02a9-4df7-ba9f-15732a0e77a6-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-23a551f6-02a9-4df7-ba9f-15732a0e77a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b63f465-cfdf-4a4c-8a8a-bf0ca4852728]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:18 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:18 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 Nov 02 12:57:18 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:19 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6" returned: 0 in 0.354s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:19 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6 Nov 02 12:57:19 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:19 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-23a551f6-02a9-4df7-ba9f-15732a0e77a6" returned: 0 in 0.254s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-23a551f6-02a9-4df7-ba9f-15732a0e77a6" released by "delete_volume" :: held 0.666s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Created reservations ['3d6edf8d-ac66-4c63-ae04-475adf816ca3', '0ea648f4-ce5c-4eee-8e0f-548e83bd878e', '608ff965-54f4-4a86-a6b1-f4954ef46c7c', '1f5d4308-4bfb-46d4-a18d-1d2c77885014'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:19 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:19 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:19 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:19 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:19 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-a77633aa-aa77-4a8d-b0b3-f967d242a1d5 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-23a551f6-02a9-4df7-ba9f-15732a0e77a6-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (3c72f02a-773a-4687-a048-6e1e52018c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972649bd-6f22-4bce-b137-92034b64a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972649bd-6f22-4bce-b137-92034b64a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007754572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbcb7c9-6bc2-448f-8738-3e2406788e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:20Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88f7cc0-9ca3-4089-a327-f61d4e689c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88f7cc0-9ca3-4089-a327-f61d4e689c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090808e6-36e5-4946-9b61-e3f31d1ae0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090808e6-36e5-4946-9b61-e3f31d1ae0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbcb7c9-6bc2-448f-8738-3e2406788e68', 'volume_name': 'volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1ee59-dd3d-406f-a075-cc04d13f3c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1ee59-dd3d-406f-a075-cc04d13f3c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562088a2-1b5d-4b91-9ae4-9a7fdc61d787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Volume 7bbcb7c9-6bc2-448f-8738-3e2406788e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68', 'volume_size': 1} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2007754572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbcb7c9-6bc2-448f-8738-3e2406788e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:20Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Creating volume 7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:20 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:20 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 1073741824 Nov 02 12:57:20 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:20 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 1073741824" returned: 0 in 0.413s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:20 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 Nov 02 12:57:20 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:20 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562088a2-1b5d-4b91-9ae4-9a7fdc61d787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75760e9b-4668-44a2-9942-4511b1c971a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:20 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Volume volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 (7bbcb7c9-6bc2-448f-8738-3e2406788e68): created successfully Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75760e9b-4668-44a2-9942-4511b1c971a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:20 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (3c72f02a-773a-4687-a048-6e1e52018c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:20 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-c7b891af-1181-4c14-a038-efb39d4764ca tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot a3286632-6416-48e4-bd44-75031705afb6 of volume 7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc4024-c3cf-495a-aa41-29f5e3dcad83]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:21 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 Nov 02 12:57:21 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:21 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68" returned: 0 in 0.371s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:21 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:21 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 1G Nov 02 12:57:21 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:22 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 1G" returned: 0 in 0.387s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:22 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 Nov 02 12:57:22 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:22 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6" returned: 0 in 0.278s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:22 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 is being set with open permissions: ugo+rw Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:22 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 Nov 02 12:57:22 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:22 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6" returned: 0 in 0.233s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:22 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info Nov 02 12:57:22 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:22 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:22 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info is being set with open permissions: ugo+rw Nov 02 12:57:22 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:22 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info Nov 02 12:57:22 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:23 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.info" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:23 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-e619d187-abf8-4f1f-9cd7-d8dc095a076a tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-a3286632-6416-48e4-bd44-75031705afb6-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-a3286632-6416-48e4-bd44-75031705afb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-a3286632-6416-48e4-bd44-75031705afb6" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-a3286632-6416-48e4-bd44-75031705afb6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot a3286632-6416-48e4-bd44-75031705afb6 of volume 7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd96469-199e-4780-8f1b-e82aad8ae3fb]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:23 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 Nov 02 12:57:23 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:23 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9562354-5d79-4f3a-a082-7bc7a4618116]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:23 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:23 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 Nov 02 12:57:23 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:24 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68" returned: 0 in 0.340s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:24 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 Nov 02 12:57:24 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:24 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6" returned: 0 in 0.330s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:24 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6 Nov 02 12:57:24 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:24 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68.a3286632-6416-48e4-bd44-75031705afb6" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-a3286632-6416-48e4-bd44-75031705afb6" released by "_delete_snapshot" :: held 1.359s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" released by "delete_snapshot" :: held 1.379s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Created reservations ['4c197201-23bf-4c01-aa85-065c38a4095a', '6f71b1c2-1ab8-4685-8339-1f66069a491f', '022d8240-a53c-4c68-847f-fc18e962c56c', '018a8741-78c1-43e5-a22c-9101018a9b6c'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:24 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:24 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-dd4e7aa3-b3aa-4672-bbb7-8f8b0c687314 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-a3286632-6416-48e4-bd44-75031705afb6-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-7bbcb7c9-6bc2-448f-8738-3e2406788e68-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-7bbcb7c9-6bc2-448f-8738-3e2406788e68-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5f7fe-1fec-4380-8f7b-a7f1c86c17c3]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:25 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 Nov 02 12:57:25 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:25 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:25 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:26 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68 Nov 02 12:57:26 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:26 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-7bbcb7c9-6bc2-448f-8738-3e2406788e68" returned: 0 in 0.231s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-7bbcb7c9-6bc2-448f-8738-3e2406788e68" released by "delete_volume" :: held 0.634s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Created reservations ['dd7b854f-b518-4867-ad07-a39aaac30c7f', '405ef6a7-fbbe-4c41-802f-395553fe52cc', 'eb422116-a889-46c6-bbe3-0f3121632998', '05461277-4504-4ca2-b4a5-f9174739e962'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:26 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:26 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:26 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:26 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:26 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-1d5008a0-1b6e-42b2-9405-6af36fcf5250 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-7bbcb7c9-6bc2-448f-8738-3e2406788e68-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c8760cfb-4a6f-4224-8c6c-743c93d239a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7e2be5-8e51-4440-b277-156a33bfcd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7e2be5-8e51-4440-b277-156a33bfcd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648893471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d704f067-6725-43ee-a1fa-214234de831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:27Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77988a57-4c10-47a8-a8d1-6be9dda66cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77988a57-4c10-47a8-a8d1-6be9dda66cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ad6629-311c-44d2-974b-480d1f70822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ad6629-311c-44d2-974b-480d1f70822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd704f067-6725-43ee-a1fa-214234de831c', 'volume_name': 'volume-d704f067-6725-43ee-a1fa-214234de831c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d39ad0-3f43-4036-8ea0-c0b5b0c1f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d39ad0-3f43-4036-8ea0-c0b5b0c1f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bc301-f1f7-4bcc-8b40-56f3e15207ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Volume d704f067-6725-43ee-a1fa-214234de831c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d704f067-6725-43ee-a1fa-214234de831c', 'volume_size': 1} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648893471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d704f067-6725-43ee-a1fa-214234de831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:27Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Creating volume d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:27 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:27 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c 1073741824 Nov 02 12:57:27 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:27 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c 1073741824" returned: 0 in 0.398s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:27 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c Nov 02 12:57:27 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:27 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c" returned: 0 in 0.237s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886bc301-f1f7-4bcc-8b40-56f3e15207ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d704f067-6725-43ee-a1fa-214234de831c', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986f820f-adf3-4b41-8e1d-18108392ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:27 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Volume volume-d704f067-6725-43ee-a1fa-214234de831c (d704f067-6725-43ee-a1fa-214234de831c): created successfully Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986f820f-adf3-4b41-8e1d-18108392ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:27 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c8760cfb-4a6f-4224-8c6c-743c93d239a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:27 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f25ab7d7-df4d-4355-9e8b-b8d02e345fc0 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot d7dda082-8cf3-40c9-82af-47a971dca6ca of volume d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9e0c1-e4fd-4090-8cfd-ad0ff276ad5f]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:28 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c Nov 02 12:57:28 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:28 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c" returned: 0 in 0.354s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:28 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca 1G Nov 02 12:57:28 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:28 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:28 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:28 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:29 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca 1G" returned: 0 in 0.394s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d704f067-6725-43ee-a1fa-214234de831c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:29 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d704f067-6725-43ee-a1fa-214234de831c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca Nov 02 12:57:29 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:29 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.277s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_service.periodic_task [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] Running periodic task VolumeManager._thread_info {{(pid=86731) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread count: 28 {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-70d0e60a-a1dc-4e8a-99e9-5c5dcc591019 None None] thread info: [<_MainThread(MainThread, started 136184115073152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86731) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:57:29 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d704f067-6725-43ee-a1fa-214234de831c -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca" returned: 0 in 0.295s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca is being set with open permissions: ugo+rw Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:29 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca Nov 02 12:57:29 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:29 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca" returned: 0 in 0.238s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:29 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info Nov 02 12:57:29 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:29 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:29 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info is being set with open permissions: ugo+rw Nov 02 12:57:29 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:29 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info Nov 02 12:57:29 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:30 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.info" returned: 0 in 0.235s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:30 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-40cace9a-b3d7-4976-a5d1-eb6f769d5d5b tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-d7dda082-8cf3-40c9-82af-47a971dca6ca-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-d7dda082-8cf3-40c9-82af-47a971dca6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-d7dda082-8cf3-40c9-82af-47a971dca6ca" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d7dda082-8cf3-40c9-82af-47a971dca6ca" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot d7dda082-8cf3-40c9-82af-47a971dca6ca of volume d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922ee77-3424-4eb5-b49f-4c9dc708dd91]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:30 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca Nov 02 12:57:30 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:30 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca" returned: 0 in 0.367s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d704f067-6725-43ee-a1fa-214234de831c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd22e06-6eb3-44e8-b15d-7cf28aabb196]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:30 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:30 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c Nov 02 12:57:30 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:31 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c" returned: 0 in 0.343s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:31 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca Nov 02 12:57:31 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:31 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca" returned: 0 in 0.319s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:31 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca Nov 02 12:57:31 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:31 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c.d7dda082-8cf3-40c9-82af-47a971dca6ca" returned: 0 in 0.250s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d7dda082-8cf3-40c9-82af-47a971dca6ca" released by "_delete_snapshot" :: held 1.368s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" released by "delete_snapshot" :: held 1.390s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Created reservations ['dfb0b3cb-30d9-49e9-8690-8a5f785298a9', 'c92aa305-e0f6-4aa8-8b26-bdf738b5b165', '08601200-8a68-466e-b98f-046d43e7b688', '0191790a-476b-41da-a145-e5e43e39097d'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:31 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:31 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0fd884f4-7a82-4576-9756-c48fed999ed4 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-d7dda082-8cf3-40c9-82af-47a971dca6ca-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-d704f067-6725-43ee-a1fa-214234de831c-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-d704f067-6725-43ee-a1fa-214234de831c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" acquired by "delete_volume" :: waited 0.017s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf49b22-a2e4-4648-aa2d-d89fac61750e]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:32 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:32 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c Nov 02 12:57:32 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:33 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:33 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c Nov 02 12:57:33 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:33 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-d704f067-6725-43ee-a1fa-214234de831c" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-d704f067-6725-43ee-a1fa-214234de831c" released by "delete_volume" :: held 0.665s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Created reservations ['8e8bef71-ec43-4985-92ab-06460b4b3d48', '50503745-ef1b-41e5-87ef-5ec89e82468d', 'cd7804e7-6cdd-4bfd-bbfa-1812dfa362ea', '6be1dfb0-6cfb-4144-bec7-17d66dc9eafb'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:33 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:33 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:33 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:33 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:33 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b823da9a-5f2e-4ea6-b2ad-ae0f23663561 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-d704f067-6725-43ee-a1fa-214234de831c-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c442166a-42a7-4a73-ac27-8dd25ff69557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba75f7-156c-4afb-b9cb-48bae71c5e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba75f7-156c-4afb-b9cb-48bae71c5e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892470181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdefb11-646f-4906-83fc-1bc1ba71c9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:34Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976e6120-0ac5-483f-ba7f-f76b1993e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976e6120-0ac5-483f-ba7f-f76b1993e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be51b748-4bf4-4ca7-ab29-7a21836e763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be51b748-4bf4-4ca7-ab29-7a21836e763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdefb11-646f-4906-83fc-1bc1ba71c9cf', 'volume_name': 'volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055589a4-2a38-4c4e-92e7-bdf165cc6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055589a4-2a38-4c4e-92e7-bdf165cc6a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59053f5a-3008-4f54-b940-09655c8e3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Volume 3bdefb11-646f-4906-83fc-1bc1ba71c9cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf', 'volume_size': 1} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892470181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdefb11-646f-4906-83fc-1bc1ba71c9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:34Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Creating volume 3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:34 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:34 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf 1073741824 Nov 02 12:57:34 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:34 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf 1073741824" returned: 0 in 0.396s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:34 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf Nov 02 12:57:34 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:34 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59053f5a-3008-4f54-b940-09655c8e3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0144bc-0bea-40ae-9df0-2e521c0806df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:34 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Volume volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf (3bdefb11-646f-4906-83fc-1bc1ba71c9cf): created successfully Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0144bc-0bea-40ae-9df0-2e521c0806df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:34 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (c442166a-42a7-4a73-ac27-8dd25ff69557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:34 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-79e618db-dd6a-4bfe-8ee3-dad5dc2cb512 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot 136d695f-8678-47b2-ad41-686b6f7e3ed4 of volume 3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8733e3-3c8f-4f96-bad0-7a04717b13e6]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:35 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf Nov 02 12:57:35 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:35 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" returned: 0 in 0.356s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:35 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:35 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 1G Nov 02 12:57:35 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:36 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 1G" returned: 0 in 0.379s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:36 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 Nov 02 12:57:36 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:36 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:36 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 is being set with open permissions: ugo+rw Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:36 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 Nov 02 12:57:36 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:36 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:36 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info Nov 02 12:57:36 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:36 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:36 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info is being set with open permissions: ugo+rw Nov 02 12:57:36 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:36 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info Nov 02 12:57:36 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:37 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.info" returned: 0 in 0.247s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:37 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-856af57e-342c-4701-970b-5a429b000af4 tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-136d695f-8678-47b2-ad41-686b6f7e3ed4-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-136d695f-8678-47b2-ad41-686b6f7e3ed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-136d695f-8678-47b2-ad41-686b6f7e3ed4" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-136d695f-8678-47b2-ad41-686b6f7e3ed4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot 136d695f-8678-47b2-ad41-686b6f7e3ed4 of volume 3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[191098d1-3af9-4329-8997-7d9843b9ea7c]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:37 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 Nov 02 12:57:37 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:37 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0691007-23fe-4ec8-8d2c-ba2ca74a1f2a]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:37 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:38 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf Nov 02 12:57:38 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:38 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" returned: 0 in 0.350s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:38 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 Nov 02 12:57:38 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:38 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4" returned: 0 in 0.327s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:38 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4 Nov 02 12:57:38 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:38 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf.136d695f-8678-47b2-ad41-686b6f7e3ed4" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-136d695f-8678-47b2-ad41-686b6f7e3ed4" released by "_delete_snapshot" :: held 1.363s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" released by "delete_snapshot" :: held 1.389s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Created reservations ['275576f4-d655-477f-bc91-9074a2e9987e', 'c45dc0ee-ca35-4948-a66e-dd86c033fa87', '042a706d-b7bc-4514-8605-6f1397e70cb7', 'f3995676-4086-4cb2-9dfc-93bbf7738167'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:38 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:38 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-b84f060d-660d-44c0-a9a7-229072109d39 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-136d695f-8678-47b2-ad41-686b6f7e3ed4-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-3bdefb11-646f-4906-83fc-1bc1ba71c9cf-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "cinder-3bdefb11-646f-4906-83fc-1bc1ba71c9cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" acquired by "delete_volume" :: waited 0.013s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[643098f7-85de-46b9-a6bf-80ab83ed80ad]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:39 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:39 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf Nov 02 12:57:39 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:40 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" returned: 0 in 0.342s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:40 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf Nov 02 12:57:40 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:40 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" returned: 0 in 0.242s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-3bdefb11-646f-4906-83fc-1bc1ba71c9cf" released by "delete_volume" :: held 0.656s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Created reservations ['8051393a-ce54-4b6d-a61f-28bb5add4c5c', 'e1de5ea4-1299-478a-b25d-76da2603fa29', '29e46e1c-6358-4648-94e6-c97098ef13f6', '33a2326f-3fe0-425a-a18f-54d1075c65c3'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:40 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:40 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:40 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.248s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:40 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:40 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-fb1d6ed0-e4cb-4e56-a38d-d8ac1af424aa tempest-ProjectMemberTests-1699670525 None] Lock "cinder-3bdefb11-646f-4906-83fc-1bc1ba71c9cf-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86731) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (49356893-39c3-4932-8238-0d5152190fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a5a3d0-c0e8-4d9e-b7a6-8ec78b40d765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a5a3d0-c0e8-4d9e-b7a6-8ec78b40d765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244656075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c41f14d-8f20-485b-a7a5-d9ff634bfc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:41Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed64a61d-9530-435f-88b2-6dc8d0b91eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed64a61d-9530-435f-88b2-6dc8d0b91eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b079426-f1d7-4506-926d-ae9fb5aa2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b079426-f1d7-4506-926d-ae9fb5aa2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c41f14d-8f20-485b-a7a5-d9ff634bfc9d', 'volume_name': 'volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fe047a-51f3-436b-9d13-cd59dc97684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fe047a-51f3-436b-9d13-cd59dc97684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e14201-0cc3-4720-9a60-45bb529566c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Volume 9c41f14d-8f20-485b-a7a5-d9ff634bfc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d', 'volume_size': 1} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244656075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c41f14d-8f20-485b-a7a5-d9ff634bfc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31c8e2519c94980aea030193000b642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:57:41Z,use_quota=True,user_id='29506607c5e04da49817cd21b49d6f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5ae9ecd-435a-4426-83f2-f09900688013),volume_type_id=a5ae9ecd-435a-4426-83f2-f09900688013)}" {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Creating volume 9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:291}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Selected osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 as target Quobyte volume. {{(pid=86731) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:57:41 devstack cinder-volume[86731]: INFO cinder.volume.drivers.remotefs [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] casted to osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755 Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d 1073741824 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:41 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d 1073741824 Nov 02 12:57:41 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:41 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d 1073741824" returned: 0 in 0.412s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:41 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d Nov 02 12:57:41 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:41 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" returned: 0 in 0.254s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'} {{(pid=86731) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1547}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e14201-0cc3-4720-9a60-45bb529566c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d', 'volume_size': 1}' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bb61c4-0a6c-430f-ab9b-2209f86069d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:57:41 devstack cinder-volume[86731]: INFO cinder.volume.flows.manager.create_volume [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Volume volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d (9c41f14d-8f20-485b-a7a5-d9ff634bfc9d): created successfully Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bb61c4-0a6c-430f-ab9b-2209f86069d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86731) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:57:41 devstack cinder-volume[86731]: DEBUG cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Flow 'volume_create_manager' (49356893-39c3-4932-8238-0d5152190fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86731) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:57:42 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6be64e2e-55c6-4881-afa9-92fd7390ee06 tempest-ProjectMemberTests-1699670525 None] Created volume successfully. Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Creating offline snapshot c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 of volume 9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1797}} Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077a4f6-8eac-4450-b511-97e989a4efe8]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:42 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d Nov 02 12:57:42 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:42 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" returned: 0 in 0.360s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:42 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 1G {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:42 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 1G Nov 02 12:57:42 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:43 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 1G" returned: 0 in 0.395s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:43 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 Nov 02 12:57:43 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:43 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d -F qcow2 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" returned: 0 in 0.284s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 is being set with open permissions: ugo+rw Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:43 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 Nov 02 12:57:43 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:43 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" returned: 0 in 0.239s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:43 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info Nov 02 12:57:43 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:43 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info" returned: 0 in 0.243s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:43 devstack cinder-volume[86731]: WARNING cinder.volume.drivers.remotefs [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info is being set with open permissions: ugo+rw Nov 02 12:57:43 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:43 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info Nov 02 12:57:43 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:44 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.info" returned: 0 in 0.240s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:44 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-6c6cf4f3-9741-4b58-b1bc-78d212ad15e0 tempest-ProjectMemberTests-1699670525 None] Create snapshot completed successfully Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76-delete_snapshot" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" by "delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" by "_delete_snapshot" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Deleting offline snapshot c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 of volume 9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1281}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] snapshot_file for this snap is: volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1310}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9df333-ef08-4e17-b154-5407384a5c96]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:44 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:44 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 Nov 02 12:57:44 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:45 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" returned: 0 in 0.357s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86731) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:889}} Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8028a99-4f29-4a7c-9d63-d13fb12dcd06]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:45 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d Nov 02 12:57:45 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:45 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" returned: 0 in 0.353s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:45 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 Nov 02 12:57:45 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:45 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" returned: 0 in 0.334s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:45 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76 Nov 02 12:57:45 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:45 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:45 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d.c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76" released by "_delete_snapshot" :: held 1.376s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" released by "delete_snapshot" :: held 1.402s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Created reservations ['f813c511-7f6c-4f43-9b56-ffbb954ff43f', 'dbec1311-0b05-4fab-9ad5-1bbea804f437', '584ea6cf-9e40-4db3-959c-4f86faf23fc5', '2ffd8104-2aad-4429-88a1-87a5817788ba'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:46 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Delete snapshot completed successfully. Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-f2ebd47c-070a-41f1-8e97-277df51e2f7b tempest-ProjectMemberTests-1699670525 None] Lock "cinder-c8e78fd9-c8fd-4f6f-a9d4-32ee75ca1a76-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d-delete_volume" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" by "delete_volume" {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" acquired by "delete_volume" :: waited 0.014s {{(pid=86731) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea90fc1-90b4-49f2-883c-86e4d807c9a9]: (4, 'qcow2') {{(pid=87461) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:57:46 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:46 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d Nov 02 12:57:46 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:47 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" returned: 0 in 0.368s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:47 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d Nov 02 12:57:47 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:47 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36/volume-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" returned: 0 in 0.241s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-quobyte-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d" released by "delete_volume" :: held 0.667s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.quota [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Created reservations ['171dd04f-35ed-48e8-993d-0c1d9d1af53a', '0fd5d0ce-6a92-4ec6-8d2e-e1836ea31d7c', 'aec7521d-2eb6-4803-95e8-5ca6c67bde8c', '633c44e4-2207-4782-bdbc-96e7a2abae34'] {{(pid=86731) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755': None} {{(pid=86731) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.volume.drivers.quobyte [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5a18ffc4-12c9-4548-92bd-6949c4bf5755'] {{(pid=86731) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.lockutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86731) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:57:47 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36 Nov 02 12:57:47 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:57:47 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG oslo_concurrency.processutils [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/de36226efd3a50f51afcc2f04907de36" returned: 0 in 0.255s {{(pid=86731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.manager [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Notifying Schedulers of capabilities ... {{(pid=86731) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:57:47 devstack cinder-volume[86731]: INFO cinder.volume.manager [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Deleted volume successfully. Nov 02 12:57:47 devstack cinder-volume[86731]: DEBUG cinder.coordination [None req-0cebaffa-c280-4cbe-bbf2-91c3ddffb549 tempest-ProjectMemberTests-1699670525 None] Lock "cinder-9c41f14d-8f20-485b-a7a5-d9ff634bfc9d-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86731) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:58:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:DELETE=11,cinder:UPDATE=122,cinder:INSERT=29,cinder:SELECT=92 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:58:00 devstack cinder-volume[86731]: DEBUG dbcounter [-] [86731] Writing DB stats cinder:SELECT=82,cinder:INSERT=35,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=86731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}